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(57) A multimedia optical disk from which special 
reproduction can be performed even when a cell is 
shared by a plurality of program chains (VTS_PGC) or 
even when a system stream (CELL) is divided and a 
plurality of ceils are interleaved in the system stream 
(CELL). A program chain (VTS_PGC) is composed of a 
plurality of system streams (CELL) in which moving pic- 
ture data and reproduction control information (NV) 
including trick play information describing the positional 
information of the data to be reproduced next are inter- 
leaved. Program chain information (VTS_PGC) repre- 
senting the order of reproduction of the system streams 
(CELL) is written in a prescribed area. The positional 
information of the first data and that of the last reproduc- 
tion control information (NV) of each of the system 
stream (CELL) are designated in accordance with the 
order of reproduction of the system streams (CELL). A 
reproducing device, reproducing method and recording 
method for such a multimedia optical disk are also dis- 
closed. 
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Description 

Technical ReW 

The present invention relates to a method and 
apparatus for system encoding bitstreams to connect 
seamlessly thereof and. more particularly, bitstreams 
for use in an authoring system for variously processing 
a data bitstream comprising the video data, audio data, 
and sub-picture data constituting each of plural program 
titles containing related video data, audio data, and sub- 
picture data content to generate a bitstream from which 
a new title containing the content desired by the user 
can be reproduced, and efficiently recording and repro- 
ducing said generated bitstream using a particular 
recording medium. 



Background Art 

Authoring systems used to produce program titles 
comprising related video data, audio data, and sub-pic- 
ture data by digitally processing, for exanple. multime- 
dia data comprising video; audio, and sub-picture data 
recorded to laser disk or video CD formats are currently 
available. 

Systems using Video-CDs in particular are able to 
record video data to a CD format disk, which was origi- 
nally designed with an approximately 600 MB recording 
capacity for storing digital audio data only, by using such 
high efficiency video compression techniques as 
MPEG. As a result of the increased effective recording 
capacity achieved using data compression techniques, 
karaoke titles and other conventional laser disk applica- 
tions are gradually being transferred to the video CD for- 
mat. 

Users today expect both sophisticated title content 
and high reproduction quality To meet these expecta- 
tions, each title must be composed from bitstreams with 
an increasingly deep hierarchical structure. The data 
size of multimedia titles written with bitstreams having 
such deep hierarchical structures, however, is ten or 
more times greater than the data size of less complex 
titles. The need to edit small image (title) details also 
makes it necessary to process and control the bitstream 
using low order hierarchical data units. 

It is therefore necessary to develop and prove a bit- 
stream structure and an advanced digital processing 
method including both recording and reproduction 
capabilities whereby a large volume, multiple level hier- 
archical digital bitstream can be efficiently controlled at 
each level of the hierarchy. Also needed are an appara- 
tus for executing this digital processing method, and a 
recording media to which the bitstream digitally proc- 
essed by said apparatus can be effidently recorded for 
storage and from which said recorded information can 
be quickly reproduced. 

Means of increasing the storage capacity of con- 
ventional optical disks have been widely researched to 



address the recording medium aspect of this problem. 
One way to increase the storage capacity of the optical 
disk is to reduce the spot diameter D of the optical 
(laser) beam. If the wavelength of the laser beam is I 
5 and the aperture of the objective lens is NA. then the 
spot diameter D is proportional to l/NA. and the storage 
capacity can be efficiently improved by decreasing I and 
increasing NA. 

As described, for example, in United States Patent 
10 5,235,581, however, coma caused by a relative tilt 
between the disk surface and the optical axis of the 
laser beam (hereafter "tilt") increases when a large 
aperture (high NA) lens is used. To prevent tilt-induced 
coma, the transparent substrate must be made very 
IS thin. The problem is that the mechanical strength of the 
disk is low when the transparent substrate is very thin. 

MPEG1 , the conventional method of recoiding and 
reproducing video, audio, and graphic signal data, has 
also been replaced by the more robust MPEG2 method, 
20 which can transfer large data volumes at a higher rate. 
It should be noted that the compression method and 
data format of the MPEG2 standard differ somewhat 
from those of MPEGI. The specific content of and dif- 
ferences between MPEGI and MPEG2 are described in 
25 detail in the ISO-11172 and ISO-13818 MPEG stand- 
ards, and further description thereof is omitted below. 

Note, however, that while the structure of the 
encoded video stream is defined in the MPEG2 spedfi- 
catk>n. the hierarchical structure of the system stream 
30 and the method of processing lower hierarchical levels 
are not defined. 

As described above, it is therefore not possible in a 
conventional authoring system to process a large data 
stream containing suffident information to satisfy many 
35 different user requirements. Moreover, even if such a 
processing method were available, the processed data 
recorded thereto cannot be repeatedly used to reduce 
data redundancy because there is no large capacity 
recording medium currently available that can effidently 
40 record and reproduce high volume bitstreams such as 
described above. 

More spedfically. particular significant hardware 
and software requirements must be satisfied in order to 
process a bitstream using a data unit smaller than the 
45 title. These ^ecific hardware requirements include sig- 
nificantly increasing the storage capacity of the record- 
ing medium and increasing the speed of digital 
processing; software requirements include inventing an 
advanced digital processing method induding a sophis- 
50 ticated data structure. 

Therefore, the object of the present invention is to 
provide an effective authoring system for controlling a 
multimedia data bitstream with advanced hardware and 
software requirements using a data unit smaller than 
55 the title to better address advanced user requirements. 
To share data between plural titles and thereby effi- 
dently utilize optical disk capacity, multi-scene control 
whereby scene data common to plural titles and the 
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desired scenes on the same time-base from within 
multi-scene periods containing plural scenes unique to 
particular r^roduction paths can be freely selected and 
reproduced is desirable. 

However, when plural scenes unique to a reproduc- s 
tion path within the multi-scene period are arranged on 
the same time-base, the scene data must be contigu- 
ous. Unselected multi-scene data Is therefore unavoida- 
bly inserted between the selected common scene data 
and the selected multi-scene data. 10 

When the recording medium is a disk or other ran- 
dom-access capable mediuhfi. the bitstream can be dis- 
cretely reproduced and high-speed special reproduction 
modes such as fast-forward and reverse play can be 
achieved by using the characteristics of the recording is 
medium to caJculate the skip destination according to 
the playback speed, or by extracting the skip destination 
from information in the bitstream. 

However, while it is possible to calculate the skip 
destination from the bit rate for seamlessly an^ayed 20 
branch data when branching, for example; from a com- 
mon scene to one of plural scenes in a multi-scene 
period during execution of a special reproduction mode 
(such as fast-forward or reverse play) using a bitstream 
containing common scene data and multi-scene peri- 25 
ods. it is not possible to calculate the skip destination for 
non-contiguously arrayed branch data (scenes). 

Furthermore, while branch destination address 
information may be recorded for one reproduction path, 
this does not make it possible to branch to other paths. 30 
Trying to record all possible path destinations is also ah 
inefficient use of limited storage capacity. Each time 
common scene data is used, the GOP address informa- 
tion of the branch destination must also be recorded, 
further conplicating the data generation process. This 3S 
is. therefore, also not practical. It is thus difficult to follow 
the desired scene data in. for example, fast-forward 
modes seeking one of multiple scenes. It is also difficult 
to follow the desired scene data in reverse mode repro- 
duction from a multi-scene period to a common scene. 40 

Therefore, the object of the present invention is to 
provide a multimedia optical disk whereby special repro- 
duction modes can be accomplished even using scene 
data arrayed to multi-scene periods; a recording method 
and a reproduction method for recording arxl reproduc-' 45 
ing saki multimedia optical disk; and a recording appa- 
ratus and a reproduction apparatus implementing said 
recording method and reproduction method, respec- 
tively. . ' " ' 

^ The present application is based upon Japanese so: 
Patent Application No, 7-276574. which was filed on 
September 29, 1995. the entire contents of which are 
expressly incorporated by reference herein. 



Disclosure of Invention 

The present invention has been developed with a 
view to substantially solving the above described disad- 
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vantages and has for its essential object to provide a 
multimedia optical disk conprising at least one informa- 
tion layer to which plural system streams and plural pro- 
gram chain information entries are recorded, said plural 
system streams interleaving in group_of _pictures GOP 
units data containing at least moving pictures, and 
reproduction control information containing special 
reproduction mode information declaring the address of 
the next data to be reproduced according to the special 
reproduction mode used, and said plural program chain 
information entries declaring the system stream repro- 
duction sequence of a program chain comprising more 
ttian one system stream, characterized by at least one 
system stream being shared by plural program chains, 
and the address inforrnation of the first r^oduction 
control information and the address Information of the 
last reproduction control information in each system 
stream being recorded to the program chain information 
according to the system stream reproduction sequence. 

Brief Descritpion of Drawings 

Rg. 1 is a graph schematically showing a structure 
of multi media bit stream according to the. present 
invention, 

Rg. 2 is a block diagram showing an authorinig 
encoder according to the present invention. 
Rg. 3 is a block diagram showing an authoring 
decoder according to the present invention, 
Rg. 4 is a side view of an optical disk storing the 
multi media bit stream of Rg. 1 , 
Rg. 5 is an enlarged view showing a portion con- 
fined by a circle of Rg. 4, - 
Rg. 6 is an enlarged view showing a portion con- 
fined by a circle of Rg, 5, 

Rg. 7 is a side view showing a variation of the opti- 
cal disk of Rg. 4, 

Rg. 8 is a side view showing another variation of 
tfie optical disk of Rg. 4, 

Rg. 9 is a plan view showing one exanrple of track 
path formed on the recording surface of the optical 
disk of Fig. 4. 

Rg. 10 is a plan view showing anotiier exarr^le of 
track path formed on the recording surface of tfie 
optical disk of Rg. 4, 

Rg. 1 1 is a diagonal view schematically showing 
one example of a frack patfi pattern formed on ttie 
optical disk of Rg. 7, 

Rg. 12 is a plan view showing anotiier exanple of 
track path formed on the recording surface of the 
optical disk of Rg. 7, 

Rg. 13 is a diagonal view schematically showing 
one example of a track path pattern formed on the 
optical disk of Rg. 8, 

Rg. 14 is a plan view showing anotiier example of 
track path formed on the recording surface of the 
optical disk of Rg. 8. 

Rg. 15 is a graph in assistance of explaining a con- 
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cept of parental control according to the present 
invention. 

Rg. 16 is a graph schematically showing the struc- 
ture of multimedia bit stream for use in Digital Video 
Disk system according to the present invention. s 
Fig. 17 is a graph schematically showing the 
encoded video stream according to the present 
invention. 

Fig. 1 8 is a graph schematically showing an internal 
structure of a video zone of Rg. 1 6. ic 
Fig, 1 9 is a graph schematically showing the stream 
management information according to the present 
invention, 

Rg. 20 is a graph schematically showing the struc- 
ture the navigation pack NV of Rg. 17, IS 
Rg. 21 is a graph is assistance of explaining a con- 
cept of parental lock playtDack control according to 
the present invention. 

Rg. 22 is a graph schematically showing the data 
structure used in a digital video disk system accoiti- 20 
ing to the present invention. 
Rg. 23 is a graph in assistance of explaining a con- 
cept of Multi-angle scene control according to the 
present invention. 

Rg. 24 is a graph in assistance of explaining a eon- 2s 
cept of multi scene data connection. 
Rg. 25 is a btock diagram showing a DVD encoder 
according to the present invention. 
Fig. 26 is a block diagram showing a DVD decoder 
according to tiie present invention. 30 
Rg. 27 is a graph schematically showing an encod- 
ing Bifbrmation table generated by the encoding 
system confroller of Rg. 25. 
Rg. 28 is a graph schematically showing an encod- 
ing information tables. 35 
Rg. 29 is a graph schematically showing an encod- 
ing parameters us^ by the video encoder of Rg 
25. 

Rg. 30 is a graph schematically showing an exam- 
ple of the contents of tiie program chain information 4o 
according to the present invention. 
Rg. 31 Is a graph schematically showing another 
example of tiie contents of tfie program chain infor- 
mation according to tfie present invention, 
Fig. 32 is a graph showing the relative sector infor- 45 
mation used to rapidly move according to the repro- 
duction speed to the sector of the VOBU containing 
the next GOP according to the present invention, 
Rg. 33 is a graph in assistance of explaining a con- 
cept of multi-angle scene control accorcling to the so 
present in invention, 

Rg. 34 is a flow chart formed by Figs. 34A and 
31 B. showing an operation of the DVD encoder of 
Fig. 25. 

Rg. 35 Is a flow chart showing detailed of the ss 
encode parameter production sub-routine of Fig 
34. 

Rg. 36 Is a flow chart showing the detailed of the 



VOB data setting routine of Fig. 35, 
Rg. 37 is a flow chart showing the encode parame- 
ters generating operation for a seamless switching. 
Rg. 38 is a flow chart showing the encode parame- 
ters generating operation for a system stream. 
Fig. 39 is a flow chart showing the encode parame- 
ters generating operation for a system stream con- 
taining a single scene, 

Rg. 40 is a flow chart showing the operation of the 
DVD encoder of Rg. 26, 

Rg. 41 is a flow chart showing details of the multi- 
angle non-seamless switching control routine of 
Rg. 40. 

Fig. 42 is a flow chart showing details of the multi- 
angle seamless switching control routine of Fig. 40. 
Rg. 43 is a flow chart showing details of the paren- 
tal lock sub-routine of Fig. 40, 
Rg. 44 is a flow chart showing details of the single 
scene subroutine of Rg. 40, 
Rgs. 45 and 46 are graphs showing decoding infor- 
mation table produced by the decoding system con- 
ti-oller of Rg. 26. 

Rg. 47 is a flow chart showing the operation of the 
DVD decoder DCD of Fig. 26. 
Rg. 48 is a ftow chart showing details of reproduc- 
tion exti-acted PGC routing of Fig. 47, 
Rg. 49 is a flow chart showing details of decoding 
data process of Rg. 48, performed by tiie stream 
buffer, is shown, 

Rg. 50 is a flow chart showing details of the 
decoder synchronization process of Rg. 49, 
Rg. 51 is a graph in assistance of explaining a spe- 
cial reproduction modes such as fast fonrard and 
reverse using an MPEG bitstream. 
Rg. 52 is a flow chart showing an operation of tiie 
decoding system controller of Fig. 26 under a spe- 
cial reproduction mode such as fast fonward or 
reverse play. 

Rgs. 53, 54. and 55 are graphs in assistance of 
explaining an example of VOBU reproduction in 
each cell during special-mode reproduction from 
plural program chains comprising common scenes 
and scenes unique to specific reproduction paths. 
Rg. 56 is a flow chart showing an operation of tiie 
decoding system contiroller of Rg. 26, 
Rg. 57 is a graph schematically showing an actual 
arrangement of data blocks recorded to a data 
recording ft-ack on a recording medium according to 
the present invention, 

Rg. 58 Is a graph schematically showing contigu- 
ous block regions and Interleaved block regions 
array. 

Fig. 59 is a graph schematically showing a content 
of a VTS titie VOBS according to the present inven- 
tion, and 

Rg. 60 is a graph schematically showing an internal 
data structure of the interleaved block regions 
according to the present invention. 
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Best mode for Carrying Out the Invention 

The prevent invention Is detailedly described with 
reference to the accompanying drawings. 

Data structure of the authoring system 

The logic structure of the multimedia data bitstream 
processed using the recording apparatus, recording 
medium, reproduction apparatus, and authoring system 
according to the present invention is described first 
below with reference to Fig. 1. 

|n this structure, one title refers to the combination 
of video and audio data expressing program content 
recognized by a user for education, entertainment, or 
other purpose. Referenced to a motion picture (movie), 
one title may correspond to the content of an entire 
movie, or to just one scene within said movie, 

A video title set (VTS) comprises the bitstream data 
containing the information for a spiecif ic number of titles. 
More specifically, each VTS comprises the video, audio, 
and other reproduction data representing the content of 
each title in the set, and control data for controlling the 
content data. 

The video zone VZ is the video data unit processed 
. by the authoring system, and comprises a specific- 
number of video title sets. More spedficaHy, each video 
zone is a linear sequence of K + 1 video title sets num- 
bered VTS #0 - VTS #K where K is an integer value of 
zero or greater. One video title set preferably the first 
video title set VTS #0. is used as the video manager 
describing the content information of the titles contained 
in each video title set 

The multimedia bitstream MBS is the largest control 
unit of the multimedia data bitstream handled by the 
authoring system of the present invention, and com- 
prises plural video zones VZ; 

Authoring encoder EC 

A preferred embodiment of the authoring encoder 
EC according to the present invention for generating a 
new multimedia bitstream MBS by re-encoding the orig- 
inal multimedia bitstream MBS according to the sce- 
nario desired by the user is shown in Rg. 2. Note that 
the original multimedia bitstream MBS conprises a 
video stream Sti containing the video information, a 
sub-picture stream St3 containing caption text and other 
auxiliary video information, and the audio stream St5 
containing the audio information. 

The video and audio streams are the bitstreams 
containing the video and audio information obtained 
from the source within a particular period of time. The 
sub-picture strecun is a bitstream containing momentary 
video information relevant to a particular scene. The 
subisicture data encoded to a single scene may be cap- 
tured to video memory and displayed continuously from 
the video memory for plural scenes as may be neces- 



sary. 

When this multimedia source data Sti , St3, and St5 
is obtained from a live broadcast, the video and audio 
signals are stpplied in real-time from a video camera or 
5 other imaging source; when the multimedia source data 
is reproduced from a video tape or other recording 
medium, the audio and video signals are not real-time 
signals. 

While the multimedia source stream is shown in 
10 Rg. 2 as comprising these three source signals, this is 
for convenience only, and it should be noted that the 
multimedia source stream may contain more than three 
types of source signals, and may contain source data 
for different titles. Multimedia source data with audio. 
IS video, and sub-picture data for plural titles are referred 
to below as multi-title streams. 

As shown in Rg. 2, the authoring encoder EC com- 
prises a scenario editor 100, encoding system controller 
200, video encoder 300, video stream buffer 400, sub- 
20 picture encoder 500. sub-picture stream buffer 600, 
audio encoder 700, audio stream buffer 800. system 
encoder 900, video zone formatter 1 300. recorder 1 200. 
and recording medium M. 

The video zone formatter 1300 comprises video 
25 object (VOB) buffer 1000. formatter 1100. and volume 
and file structure formatter 1 400. 

The bitstream encoded by the authoring encoder 
EC of the present embodiment is recorded by way of 
example only to an optical disk. 
30 The scenano editor 100 of the authoring encoder 
EC outputs the scenario data, i.e., the user-defined edit- 
ing instructions. The scenario data controls editing the 
corresponding parts of the multimedia bitstream MBS 
according to the user's nnanipulation of the video, sub- 
35 picture, and audio components of the original multime- 
dia title. This scenario editor 1 00 preferably comprises a 
display. speaker(s), keyboard, CPU. and source stream 
buffer. The scenario editor 100 is connected to an exter- 
nal multimedia bitstream source from which the multi- 
40 media source data Sti , St3, and St5 are supplied. 

The user is thus akAe to reproduce the video and 
audio components of the multimedia source data using 
the display and speaker to confirm the content of the 
generated title. The user is then able to edit the title con- 
45 tent according to the desired scenario using the key- 
board, mouse, and other command input devices while 
confirming the content of the title on the display and 
speakers. The result of this multimedia data manipula-^ - 
tion is the scenario data St7. 
50 The scenario data St7 is basically a set of instruc- 
tions describing what source data is selected from all or 
a subset of the source data containing plural titles within 
a defined time period, and how the selected source data 
is reassemtsled to reproduce the scenario (sequence) 
55 intended by the user. Based on the instructions received 
through the keyboard or other control device, the CPU 
codes the position, length, and the relative time-based 
ppsitions of the edited parts of the respective multime- 
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dia source data streams Sti. St3. and St5 to generate 
the scenario data St7. 

The source stream buffer has a specific capadty. 
and Is used to delay the nujitimedia source data 
streams St1. St3. and St5 a known time Td and then s 
output streams Stl , St3, and St5. 

This delay is required for synchronization with the 
editor encoding process. More specifically, when data 
encoding and user generation of scenario data St7 are 
executed simultaneously, i.e.. when encoding immedi- io 
ately follows editing, time Td is required to determine 
the content of the multimedia source data editing proc- 
ess based on the scenario data St7 as will be described 
further below. As a result the multimedia source data 
must be delayed by time Td to synchronize the editing is 
process during the actual encoding operation. Because 
this delay time Td is limited to the time required to syn- 
chronize the operation of the various system conpo- 
nents in the case of sequential editing as described 
above, the source stream buffer is normally achieved by 20 
means of a high speed storage medium such as semi- 
conductor memory. 

During batch editing in which all multimedia source 
data is encoded at once {t)atch encoded") after sce- 
nario data St7 is generated for the complete title, delay 2s 
time Td must be long enough to process the conplete 
title or longer. In this case, the source stream buffer may 
be a low speed, high capacity storage medium such as 
video tape, magnetic disk, or optical disk. 

The structure (type) of media used for the source 30 
stream buffer may therefore be determined according to 
the delay time Td required and the allowable manufac- 
turing cost. 

The encoding system controller 200 is connected to 
the scenario editor 100 and receives the scenario data 35 
SX7 therefrom. Based on the time-base position and 
length information of the edit segment contained in the 
scenario data St7, the encoding system controller 200 
generates the encoding parameter signals St9. Stl 1 . 
and Stl 3 for encoding the edit segment of the multime- 40 
dia source data. The encoding signals St9. Stil. and 
St13 supply the parameters used for video, sub-picture, 
and audio encoding. Including the encoding start and 
end timing. Note that multimedia source data Stl. St3. 
and St5 are output after delay time Td by the source. 4S 
stream buffer, and are therefore synchronized to encod- 
ing parameter signals St9. Stl 1 . and Stl 3. 

More specifically, encoding parameter signal St9 is 
the video ©icodtng signal specifying the encoding tim- 
ing of video stream Stl to extract the encoding segment so 
from the video stream Stl and generate the video 
encoding unit Encoding parameter signal Stil is like- 
wise the sub-picture stream encoding signal used to 
generate the sub-picture encoding unit by specifying the 
encoding timing for sub-picture stream St3. Encoding ss 
parameter signal Stl 3 is the audio encoding signal used 
to generate the audio encoding unit by specifying the 
encoding timing for audio stream St5. 



Based on the time-base relationship between the 
encoding segments of streams Stl. StS. and St5 in the 
multimedia source data contained in scenario data St7. 
the encoding system controller 200 generates the tim- 
ing signals St21. St23. and St25 arranging the encoded 
multimedia-encoded stream in the specified time-base 
relationship. 

The encoding system controller 200 also generates 
the reproduction time information IT defining the repro- 
duction time of the titie editing unit (video object. VOB). 
and the stream encoding data St33 defining the system 
encode parameters for multiplexing the encoded multi- 
media stream containing video, audio, and sub-picture 
data. Note that tiie reproduction time information IT and 
stream encoding data St33 are generated for tfie video 
object VOB of each titie in one video zone VZ. 

The encoding system controller 200 also generates 
tiie titie sequence control signal St39. which declares 
the formatting parameters for formatting tfie titie editing 
units VOB of each of the streams in a particular time- 
base relationship as a multimedia bltstream. More spe- 
df ically. tiie title sequence control signal St39 is used to 
control tiie connections between the titie editing units 
(VOB) of each title in ttie multimedia bitstream MBS. or 
to control tiie sequence of the interleaved titie editing 
unit (VOBs) interleaving tiie titie editing units VOB of 
plural reproduction patiis. 

The video encoder 300 is connected to the source 
stream buffer of the scenario editor 100 and to tiie 
encoding system conti-oller 200, and receives tiierefrom 
tiie video stream Stl and video encoding parameter sig- 
nal St9. respectively Encoding parameters supplied by 
tiie video encoding signal St9 include ttie encoding start 
and end timing, bit rate, tiie encoding conditions for the 
encoding start and end, and the material type. Possible 
material types include NTSC or PAL video signal, and 
telecine converted material. Based on tiie video ericod- 
ing parameter signal St9. tiie video encoder 300 
encodes a specific part of the video stream Stl to gen- 
erate the encoded video stream St15, 

The sub-picture encoder 500 is similariy connected 
to the source stream buffer of the scenario editor 100 
and to tfie encoding system conti-oller 200. and receives 
therefrom tiie sub-picture stream StS and sub-picture 
encoding parameter signal Stl 1 , respectively. Based on 
ttie sub-picture encoding parameter signal Stl 1 . ttie 
sub-pichjre encoder 500 encodes a specific part of ttie 
sub-pictijre sti-eam StS to generate the encoded sub- 
picture stream Stl 7. 

The audio encoder 700 is also connected to ttie 
source stream buffer of ttie scenario editor 100 and to 
ttie encoding system controller 200, and receives there- 
from ttie audio stream StS and audio encoding parame- 
ter signal Stl 3. which supplies ttie encoding start and 
end timing. Based on ttie audio encoding parameter sig- 
nal Stl 3, the audio encoder 700 encodes a specific part 
of the audio sti-eam StS to generate ttie encoded audio 
stream Stl 9. 
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The video stream buffer 400 is connected to the 
video encoder 300 and to the encoding system control- 
ler 200. The video stream buffer 400 stores the encoded 
video stream St15 input from the video encoder 300. 
and outputs the stored encoded video stream St15 as 5 
the time-delayed encoded video stream St27 based on 
the timing signal St21 supplied from the encoding sys- 
tem controller 200. 

The sub-picture stream buffer 600 is similarly con- 
nected to the sub-picture encoder 500 and to the encod- 10 
ing system contrpller 200. The sub-picture stream buffer 
600 stores the encoded sub*picture stream Sti 7 ou^Dut 
from the sub-picture encoder 600. and then outputs the 
stored encoded suthpicture stream St17 as time- 
delayed encoded sub-picture stream St29 based on the is 
timing signal St23 supplied from the encoding system 
controller 200. 

The audio stream buffer 800 is similarly connected 
to the audio encoder 700 and to the encoding system 
controller 200. The audio stream buffer 800 stores the 20 
encoded audio stream StIS input from the audio 
encoder 700. and then ou^^uts the encoded audio 
stream StI 9 as the time-delayed encoded audio stream 
St31 based on the timing signal St25 supplied from the 
encoding system controller 200. 2s 

The system encoder 900 is connected to the video 
stream buffer 400, sub-picture stream buffer 600, audio 
stream buffer 800, and the encoding systerh controller 
200, and is respectively supplied thereby with the time- 
delayed encoded video stream St27. timendelayed 30 
encoded subrpicture stream St29. time<lelayed 
encoded audio stream StSI. and the stream encoding 
data St33. Note that the system encoder 900 is a multi- 
plexer that multiplexes the time-delayed streams St27, 
St29. and St3 1 based on the stream encoding data St33 3S 
(timing signal) to generate title editing unit (VOB) St35. 
The stream encoding data St33 contains the system* 
encoding parameters, including the encoding start and 
end timing. 

The video zone formatter 1300 is connected to the 4o 
system encoder 900 and the encoding system controller 
200 from which the title editing unit (VOB) St35 and title 
sequence control signal St39 (timing signal) are respec- 
tively supplied. The title sequence control signal St39 
contain^ the formatting start and end timing, and the forr 4s 
matting parameters used to generate (format) a multi- 
media bitslream MBS. The video zone formatter 1300 
rearranges the title editing units (VOB) St35 In one 
video zone VZ in the scenario sequence defined by the 
user based on the title sequence control signal St39 to so 
generate the edited multimedia stream data St43. 

, The multimedia bitstream MBS St43 edited accord- 
ing to the user-defined scenario is then sent to the 
recorder 1200. The recorder 1200 processes the edited 
multimedia stream data St43 to the data stream St45 ss 
format of the recording medium M, and thus records the 
formatted data stream St45 to the recording medium M. 
Note that the multimedia bitstream MBS recorded to the 



M^i 



recording medium M contains the volume file structure 
VPS, which includes the physical address of the data on 
the recording medium generated by the video zone for- 
matter 1300. 

Note that the encoded multimedia bitstream MBS 
St35 may be output directly to the decoder to immedi- 
ately reproduce the edited title content. It will be obvious 
that the output multimedia bitstream MBS will hot in this 
case contain the volume file structure VPS. 

Authoring clecoder PC 

A preferred embodiment of the authoring decoder 
DC used to decode the multimedia bitstream MBS 
edited by the authoring encoder EC of the present 
Invention, and thereby reproduce the content of each 
title unit according to the user-defined scenario, is 
described next below with reference to Fig. 3; Note that 
in the preferred embodiment described below the multi- 
media bitstream St45 encoded by the authoring 
encoder EC is recorded to the recording medium M. 

As shown in Rg. 3. the authoring decoder DC com- 
prises a multimedia bitstream producer 2000. scenario 
selector 2100. decoding system controller 2300, stream 
buffer. 2400. system decoder 2S00, video buffer 26001 
sub-picture buffer 2700, audio buffer 2800, synchronizer 
2900, video decoder 3800. sub-picture decodier 3100^ 
audio decoder 3200. synthesizer 3500. video data out^ 
put terminal 3600. and audio data output terminal 3700: ^ 

The bitstream producer 2000 corrprises a record- 
ing media drive unit 2004 for driving the recording 
medium M; a reading head 2006 for reading the infor- 
mation recorded to the recording medium M and pro- 
dubing the binary read signal St57; a signal processor 
2008 for variously processing the read signal St57 to 
generate the reproduced bitstream St61; and a repro- 
duction controller 2002. 

The reproduction controller 2002 is connected to 
the decoding system controller 2300 from which the 
multimedia bitstream reproduction control signal St53 is' 
supplied, and in turn generates the reproduction control 
signals St55 and St59 respectively controllihig the 
recording media drive unit (motor) 2004 and signal 
processor 2008. 

So that the user-defined video, sub-picture, and 
audio portions of the multimedia , titie edited by the 
authoring encoder EC are reproduced, the authoring 
decoder DC comprises a scenario selector 2100 for 
selecting and reproducing the correq;x)nding scenes 
(tities). The scenario selector 2100 tiien outputs the 
selected tities as scenario data to the authoring decoder 
DC. 

The scenario selector 2100 preferably comprises a 
keytx^ard. CPU. and monitor. Using the keyt>oard, the 
user then inputs tiie desired scenario based on the con- 
tent of the scenario input by the authoring encoder EC. 
Based on the keytK>ard input the CPU generates the 
scenario selection data St51 specifying the selected 
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scenario. The scenario selector 2100 is connected by 
an infrared communications device, for example, to the 
decoding system controller 2300, to which it inputs the 
scenario selection data St51 , 

Based on the scenario selection data St51. the 
decoding system controller 2300 then generates the bit- 
stream reproduction control signal St53 controlling the 
operation of the bitstream producer 2000. 

The stream buffer 2400 has a specific buffer capac- 
ity used to temporarily store the reproduced bitstream 
St61 input from the bitstream producer 2000, extract the 
address information and initial synchronization data 
SCR (system clock reference) for each stream, and 
generate bitstream control data St63. The stream buffer 
2400 is also connected to the decoding system control- 
ler 2300, to which it supplies the generated bitstream 
control data St63. 

The synchronizer 2900 is connected to the decod- 
ing system controller 2300 from which it receives the 
system clock reference SCR contained in the synchroni- 
zation control data St81 to set the internal system cloc^ 
STC and supply the reset system dock St79 to the 
decoding system controller 2300. 

Based on this system clock St79, the decoding sys- 
tem controller 2300 also generates the stream read sig- 
nal St65 at a specific interval and outputs the read 
signal St65 to the stream buffer 2400. 

Based on the supplied read signal St65, the stream 
buffer 2400 outputs the reproduced bitstream St61 at a 
specific interval to the system decoder 2500 as bit- 
stream St67. 

Based on the scenario selection data StSI. the 
decoding system controller 2300 generates the decod- 
ing signal St69 defining the stream Ws for the video, 
sub-picture, and audio bitstreams corresponding to the 
selected scenario, and outputs to the system decoder 
2500. 

Based on the instructions contained in the decod- 
ing signal St69. the system decoder 2500 respectively 
outputs the video, sub-picture, and audio bitstreams 
input from the stream buffer 2400 to the video buffer 
2600. sub-picture buffer 2700, and audio buffer 2800 as 
the encoded Video stream St71, encoded sub-picture 
stream St73, and encoded audio stream St75. 

The system decoder 2500 detects the presentation 
time stamp PTS and decoding |ime stamp DTS of the 
smallest control unit in each bitstream St67 to generate 
the time Information signal St77. This time information 
signal St77 Is supplied to the syndironizer 2900 through 
the decoding system controller 2300 as tiie synchroni- 
zation control data SB1 . 

Based on this synchronization control data St81, 
the synchronizer 2900 determines the decoding start 
timing whereby each of the bitsfe-eams will be arranged 
in tile correct sequence after decoding, and tfien gener- 
ates and inputs tine vkleo stream decoding start signal 
St89 to the vWeo decoder 3800 based on tiiis decoding 
timing. The synchronizer 2900 also generates and sup- 



plies the sub-picture decoding start signal St91 and 
audio stream decoding start signal St93 to the sub-pic- 
ture decoder 3100 and audio decoder 3200, respec- 
tively 

s The video decoder 3800 generates the video output 
request signal St84 based on the video stream decod- 
ing start signal St89. and outputs to the video buffer 
2600. In response to the video output request signal 
St84. the video buffer 2600 outputs the video stream 
10 St83 to the video decoder 3800. The video decoder 
3800 tiius detects tfie presentation time information 
contained in the video stream St83. and disables tfie 
video output request signal St84 when the length of ttie 
received video sto-eam St83 is equivalent to the speci- 
15 fied presentation time. A video stream equal in length to 
the specified presentation time is thus decoded by the 
video decoder 3800. which outputs the reproduced 
video signal St104 to the synthesizer 3500. 

The sub-picture decoder 3100 similarly generates 
20 the sub-picture output request signal St86 based on tfie 
sub-picture decoding start signal St91. and outputs to 
the sii>-picture buffer 2700. In response to tiie sub-pic- 
ture output request signal St86. the sub-picture buffer 
2700 outputs tine sub-picture stream St85 to the sub- 
25 picture decoder 3100. Based on the presentation time 
information contained in tiie sub-picture stream St85. 
tfie sub-picture decoder 3100 decodes a lengtti of tiie 
sub-picture stream St85 corresponding to the specified 
presentation time to reproduce and supply to the syn- 
30 tfiestzer 3500 the sub-picture signal St99. 

The syntiiesizer 3500 superimposes the video sig- 
nal St104 and stto-picture signal St99 to generate and 
output tfie n^lti-picture video signal St105 to the video 
data output terminal 3600. 
35 The audto decoder 3200 generates and supplies to 
tfie audio buffer 2800 the audio output request signal 
St88 based on the audio stream decoding start signal 
St93. The audio buffer 2800 thus outputs the audio 
stream St87 to tfie audio decoder 3200. The audio 
40 decoder 3200 decodes a lengtfi of the audio stream 
St87 con'esponding to the specified presentation time 
based on the presentation time information contained in 
tfie audio stream St87. and outputs the decoded audio 
stream StlOl to the audio data output terminal 3700. 
45 It is thus possible to reproduce a user-defined mul- 
timedia bitstream MBS in real-time according to a user- 
defined scenarfo. More specifically, each time tfie user 
selects a different scenario, the authoring decoder DC 
is able to reproduce tfie titie content desired by the user 
so in the desired sequence by reproducing tiie multimedia 
bitsti-eam MBS con'esponding to the selected scenario. 

It is therefore possible by means of the authoring 
system of tfie present invention to generate a multime- 
dia bitstream according to plural user-defined scenarios 
55 by real-time or batch encoding multimedia source data 
in a manner whereby tfie substreams of the smallest 
editing units (scenes), vyhich can be divided into plural 
substreams. expressing the basic title content are 
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arranged in a specific time-base relationship. 

The multimedia bitstream thus encoded can then 
be reproduced according to the one scenario selected 
from among plural possOsle scenarios. It is also possible . 
to change scenarios while playback is in progress, i.e., s 
to select a different scenario and dynamically generate 
a new multimedia bitstream according to the most 
recently selected scenario. It is also possible to dynam- 
ically select and reproduce any of plural scenes while 
reproducing the title content according to a desired see- io 
nario. 

It is therefore possible by means of the authoring 
system of the present invention to encode and not only 
reproduce but to repeatedly reproduce a multimedia bit- 
stream MBS in real-time. is 

A detail of the authoring system is disclosed Japa- 
nese Patent Application filed September 27, 1996, and 
entitled and assigned to the same assigneie as the 
present application. 
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An example of a digital video disk (DVD) with only 
one recording surface (a single-sided DVD) is shown in 
Fig 4. 25 

The DVD recording medium RCl in the pretended 
embodiment, of the invention comprises a data record- 
ing surface RSI to and from which data Is written and 
read by emitting laser beam LS. and a protective layer 
PL1 covering the data recording surface RSI . A backing 30 
layer BL1 is also provided on the back of data recording 
surface RSI. The side of the disk on which protective 
layer PLI is provided is therefore referred to below as 
side SA (commonly "side A^. and ttie opposite side (on 
which the backing layer BL1 is provided) is referred to 35 
as side SB ("side B"). Note that digital video disk recoid- 
ing media having a single data recording surface RSI 
on only one side such as this DVD recording medium 
RCl is commonly called a single-sided single layer disk. 

A detailed illustration of area CI in Fig. 4 is shown 40 
in Fig. 5, Note that the data recording surface RSI is 
formed by applying a metallic thin film or other reflective' 
coating as a data layer 41 09 on a first transparent layer 
4108 having a particular tfiickness T1. This first trans-, 
parent layer 4108 also functions as the protective layer 45 
PLI. A second transparent substrate 4111 of a thick- 
ness T2 functions as the backing layer BL1, and is 
bonded to the first transparent layer 4108 by means of 
an adhesive layer 4110 disposed therebetweisn. 

A printing layer 41 12 for printing a disk label may so 
also be disposed on the second transparent substrate 
4111 as necessary. The printing layer 4112 does not 
usually cover the entire surface area of the second 
transparent substrate 4111 (backing layer BL1). Ixit only 
the area needed to print the text and graphics off the disk ss 
label. The area of second transparent substrate 41 1 1 to 
which the printing layer 4112 is not formed may be. left 
exposed. Light reflected from the data layer 4109 



(metallic thin film) forming the data recording surface 
RSI can thierefore be directly observed where the label 
is not printed when the digital video disk is viewed from 
skfe SB. As a result, the background looks like a silver- 
white over which the printed text and graphics float 
when tfie metallic thin film is an aluminum thin film, for 
example. 

Note that it is only necessary to provide the printing 
layer 41 12 where needed for printing, and it is not nec- 
essary to provide the printing layer 4112 over the entire 
surfoce of the backing layer BL1 . 

A detailed illustration of area C2 in Fig. 5 is shown 
in Fig. 6. Pits and lands are molded to the common con- 
tact surface between the first transparent layer 4108 
and the data layer 4109 on side SA from which data is 
read by emitting a laser beam LS, and data is recorded 
by varying the lengths of the pits and lands (i.e., the 
length of the intervals between the pits). More specifi- 
cally, the pit and land configuration formed on the first 
transparent layer 4108 is transferred to the data layer 
4109. The lengttts of the pits and lands is shorter, and 
the pitch of the data tracks formed by tiie pit sequences 
is narrower, than with a conventional Compact Disc 
(CD). The surface recording density is therefore greatiy 
improved. 

Skle SA of the first transparent layer 4108 on which 
data pits are not formed is a flat surfece. The second 
transparent substrate 41 1 1 is for reinforcement, and is a 
transparent panel made from the same material as the 
first transparent layer 4108 with both sides flat Thick- 
nesses T1 and T2 are preferably equal and commonly 
approximately 0.6 mm. txjt the invention shall not be so 
limited. 

As with a CD. information is read by irradiating the 
surface witii a laser beam LS and detecting the change 
in the reflectivity of the light spot Because the objective 
lens aperture NA can be large and the wavelength l of 
the light beam small in a digital video disk system, the 
diameter of the light spot Ls used can be reduced to 
approximately 1/1 .6 the light spot needed to read a CD. 
Note that this means the resolution of the laserbeam LS 
in the DVD systerh is approximately 1 .6 times the reiso- 
lution of a conventional CD system. 

The optical system used to read data from the dig- 
ital video disk uses a short 650 nm wavelength red sem- 
iconductor laser and an objective lens with a 0.6 mm 
aperture NA. By thus also reducing the thickness T of 
the transparent panels to 0.6 mm, more tfian 5 G& of 
data can be stored to one side of a 120 mm diameter 
optical disk. ■ - 

It is therefore possible to store motion picture 
(video) images having an extremely large per unit data 
size to a digital video disk system disk without losing 
image quality because the storage capacity of a single- 
sided, single-layer recording medium RCl with one data 
recording surface RSI as thus described is neariy ten 
times the storage capacity of a conventional CD. As a 
result while ttie video presentation time of a conven- 
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tional CD system is approximately 74 minutes if image 
quality is sacrificed, high quality video images with a 
video presentation time exceeding two hours can be 
recorded to a DVD. 

The digital video disk is therefore well-suited as a 
recording medium for video images. 

A digital video disk recording medium with plural 
recording surfaces RS as described above is shown in 
Figs. 7 and 8. The DVD recording medium RC2 shown 
in Rg. 7 comprises two recording surfaces, i.e., first 
recording surface RSI and semi-transparent second 
recording surface RS2, on the same side. i.e. side SA. 
of the disk. Data can be simultaneously recorded or 
reproduced from these two recording surfaces by using 
different laser beams LSI and LS2 for the first recording 
surface RSI and the second recording surface RS2. It is 
also possible to read/Write both recording surfaces RSI 
and RS2 using only one of the laser beams LS1 or LS2. 
Note that recording media thus comprised are called 
"single-skJe, dual-layer disks." 

It should also be noted that while two recording sur- 
faces RSI and RS2 are provided in this exanple. it is 
also possible to produce digital video disk recording 
media having more than two recording surfaces RS. 
Disks thus comprised are known as "single-sided, mufti- 
layer disks.** 

Though comprising two recording surfaces similarly 
to the recording media shown in Fig. 7. the DVD record- 
ing medium RC3 shown in Fig. 8 has the recording sur- 
faces on opposite sides of the disk. i. e., has the first 
data recording surface RSI on side SA and the second 
data recording surface RS2 on side SB. It will also be 
obvious that while only two recording surfaces are 
shown on one digital video disk in this example, more 
than two recording surfaces may also be formed on a 
double-sided digital video disk. As with the recording 
medium shown in Fig. 7, it is also possible to provkle 
two separate laser beams LSI and LS2 for recording 
surfaces RSt and RS2, or to read/write both recording 
surfaces RSI and RS2 using a single laser beam. Note 
that this type of digital video disk is called a "double- 
sided, dual-layer disk- It will also be obvious that a dou- 
ble-sided digital video disk can be comprised with two or 
more recording surfaces per side. This type of disk is 
called a "double-sided, multi-layer disk.** 

A plan view from the laser beam LS in-adiation skJe 
of the recording surface RS of the DVD recording 
medium RC is shown in Fig. 9 and Fig. 10. Note that a 
continuous spiral data recording track TR is provided 
from the inskle circumference to the outside aYcumfer- 
ence of the DVD. The data recording track TR is divided 
into plural sectors each having the same known storage 
capacity. Note tfiat for simplicity only the data recording 
\tack TR is shown in Fig. 9 with more than three sectors 
per revolution. 

As shown in Fig. 9, the data recording track TR is 
normally formed clockwise inside to outside (see arrow 
DrA) from the inside end point lA at the inside circumfer- 

^ 



ence of disk RCA to the outside end point OA at the out- 
side circumference of the disk with the disk RCA 
rotating counterclockwise RdA, This type of disk RCA is 
called a clockwise disk, and the recording track formed 
5 thereon is called a clockwise track TRA. 

Depending upon the application, the recording 
track TRB may be formed clockwise from outside to 
inside circumference (see arrow DrB in Rg. 10) from the 
outside end point OB at the outside circumference of 
10 disk RGB to the inside end point IB at the inside circuri>- 
ference of the disk with the disk RGB rotating clockwise 
RdB. Because the recording track appears to wind 
counterclockwise when viewed from the inside circum- 
ference to the outside circumference on disks with the 
IS recording track formed in the direction of arrow DrB. 
these disks are refen-ed to as counterclockwise disk 
RGB with counterclockwise track TRB to distinguish 
them from disk RCA in Rg. 9. Note that track directions 
DrA and DrB are the track paths along which the laser 
20 beam travels when scanning the tracks for recording 
and playback. Direction of disk rotation RdA in which 
disk RCA turns is thus opposite the direction of track 
path DrA, and direction of disk rotation RdB in whfch 
disk RGB turns is thus opposite the direction of track 
25 path DrB. 

An exploded view of the single-sided, dual-layer 
disk RG2 shown in Fig. 7 is shown as disk RG2o in f=ig. 
1 1. Note that the recording tracks formed on the two 
recording surfaces run in opposite directions. Specif i- 
30 cally, a clockwise recording track TRA as shown in Rg. 
9 is formed in clockwise direction DrA on the (lower) first 
data recording surface RSI. and a counterclockwise 
recording track TRB formed in counterclockwise direc- 
tion DrB as shown in Fig. 10 Is provided on the (upper) 
35 second data recording surface RS2. As a result, the out- 
side end points OA and OB of the first and second (top 
and bottom) tracks are at the same radial position rela- 
tive to the center axis of the disk RC2o. Note that track 
paths DrA and DrB of tracks TR are also the data 
read/write directions to disk RG. The first and second 
(top and bottom) recording tracks thus wind opposite 
each other with this disk RC. i.e.. the track paths DrA 
and DrB of the top and bottom recording layers are 
opposite track pattTS. 

Opposite track path type, single-sided, dual-layer 
disks RC2o rotate in direction RdA corresponding to the 
first recording surface RSI with the laser beam LS 
traveling along track path DrA to trace the recording 
track on the first recording surface RSI . When the laser 
so beam LiS reaches the outskle end point OA. the laser 
beam LS can be refocused to end point OB on the sec- 
ond recording surface RS2 to continue tracing the 
recording track from the first to the second recording 
surtace uninterrtipted. The physical distance between 
ss the recording tracks TRA and TRB on the first and sec- 
ond recording surfaces RSI and RS2 can thus be 
instantaneously eliminated by simply adjusting the 
focus of the laser beam LS. 
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It is therefore possitrfe with an opposite track path 
type, single-sided, dual-layer disk RC2o to easily proc- 
ess the recording tracks disposed to physically discrete . 
top and bottom recording sur^ces as a single continu- 
ous recording track. It is therefore also possible in an 5 
authoring system as described above with reference to 
Fig. 1 to continuously record the multimedia bitstream 
MBS that Is the largest multimedia data -management 
unit to two discrete recording surfaces RSI and RS2 on 
a single recording medium RC2o. ra 

It should be noted that the tracks on recording sur- 
faces RS1 and RS2 can be wound in the directions 
opposite those described atx>ve. i.e.. the counterclock-x 
wise track TRB may be provided on the first recording 
surface RSI and the clockwise track TRA on the second is 
recording surface RS2. In this case the direction of disk 
rotation is also changed to a clockwise rotation RdB. 
thereby enabling the two recording sur^ces to be used 
as comprising a single continuous recording track as 
described above. For simplification . a further exanple of 20 
this type of disk is therefore neither shown nor 
desaibed below. 

It is therefore possible by thus constructing the dig- 
ital video disk to record the multimedia bitstream MBS 
for a feature-length title to a single opposite track path 25 
type, single-sided, dual-layer disk RC2o. Note that this 
type of digital video disk medium is called a single-sided 
dual-layer disk with opposite track paths. 

Another example of the single-sided, dual -layer 
DVD recording medium RC2 shown in Fig. 7 is shown 30 
as disk RC2p in Fig. 1 2. The recording tracks formed on 
both first and second recording surfeices RSI and RS2 
are clockwise tracks TRA as shown in Rg. 9, In this 
case, the single-sided, dual-layer disk RC2p rotates 
counterclockwise in the direction of arrow RdA and the 3S 
direction of jaser beam LS travel is the same as the 
direction of the track spiral, i.e.. the track patiis of the 
top and bottom recording surfaces are nruitually parallel 
(parallel track patfis). The outside end points OA of b)Oth 
top and bottom tracks are again preferably positioned at 40 
the same radial position relative to the center axis of the 
disk RC2p as described above. As also described : , 
above with disk RC2o shown in Fig. 11 , the access point 
can be instantaneously shifted from outside end point 
OA of track TRA on the first recording surface RSI to 45 
the outside end point OA of track TRA on the second 
recording surface RS2 by appropriately acljusting the 
focus of the laser beam LS at outside end point OA. 

However, for the laser beam LS to continuously : 
access the docKwise recording track TRA on the sec- so> 
end recording surface RS2. tiie recording medium 
RC2p must be driven in the opposite direction (clock- 
wise, opposite direction RdA). Depending on the radial 
position of tfie laser beam LS, however, it is inefficient to 
change tiie rotational direction of the recording medium, ss 
As shown by tiie diagonal arrow in Fig. 12. tiie laser 
beam LS is therefore moved from the outside end point 
OA of the track on the first recording surface RSI to the 



inside end point I A of the track on tiie second recording 
surface RS2 to use these physically discrete recording 
tracks as one logically continuous recording track 

Rather than using the recording tracks on top and 
bottom recording surfaces as one continuous recording 
track, it is also possit)le to use tiie recording tracks to 
record the multimedia bitstreams MBS for different 
titles. This type of digital video disk recording medium is 
called a "single-sided, dual-layer disk with parallel track 
paths." 

Note that if the direction of the tracks formed on the 
recording surfeices RSI and RS2 is opposite that 
described alcove, i.e.. counterclockwise recording tracks 
TRB are formed, disk operation remains the same as 
that described above except for the direction of disk 
rotation, which is clockwise as shown by arrow RdB. 

Whether using clockwise or counterclockwise 
recording tracks, the isingle-sided. dual-layer disk RC2p 
with parallel track paths thus desaibed is well-suited to 
storing on a single disk encyclopedia and similar multi- 
media bitstreams comprising multiple tities that are fre- 
quently and randohrtiy accessed. 

An exploded view of the dual-sided single-layer 
DVD recording medium RG3 comprising one recording 
surface layer RSI and RS2 on each side as shown In 
Fig. 8 is shown as DVD recording medium RC3s in Fig. 
13. Clockwise recording track TRA is provided on the 
one recording surface RS1, and a counterck>ckwise 
recording track TRB is provided on the other recording 
surface BS2. As in the preceding recording media, the 
outside end points OA and OB of the recording tracks 
on each r<ecording surface are preferably positioned at 
the same radial position relative to the center axis of the 
DVD recording medium RC3s. 

Note that while the recording tracks on these 
recording surfeces RSI and RS2 rotate In opposite 
directions, the track paths are symmetrical. This type of 
recording medium is therefore known as a dout)le-sided 
dual layer disk with symmetrical track paths. This dou- 
ble-sided dual layer disk with symmeb^ical track paths 
RC3s rotates in direction RdA when.readingAfvriting the 
first recording surface RS1. As a result, the track path 
on the second recording surface RS2 on the opposite 
side is opposite the direction DrB in which the track 
winds, i.e., direction DrA. Accessing both recording sur- 
faces RSI and RS2 using a. single laser beam LS is 
therefore not realistic in-espective of whettier access is 
continuous or non-continuous. In addition, a multimedia 
bitstream MBS is separately recorded to the recording 
surfeices on the first and second sides of the disk 

A different example of the doutHe-sided single layer 
disk RC3 shown in Fig. 8 is shown in Rg. 14 as disk 
RC3a. Note that this disk comprises clockwise record- 
ing tracte TRA as shown in Rg. 9 on both recording sur- 
faces RSI and .RS2. As with tiie preceding recording 
media, the outside end points OA and OA of the record- 
ing tracks on each recording surface are preferably 
positioned at the same radial position relative to the 
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center axis of the DVD recording medium RC3a, Unlike 
the double-sided dual layer disk with symmetrical track 
paths RC3S described above, the tracks on these 
recording surfaces RSI and RS2 are asymmetrical. 
This type of disk is therefore known as a double-sided 
dual layer disk with asymmetrical track paths. This dou- 
fcrfe-sided dual l^er disk with asymmetrical track paths 
RC3a rotates in direction RdA when reading/writing the 
first recording surface RSI. As a result, the track path 
on the second recording surface RS2 on the opposite 
side is opposite the direction DrA in which the track 
winds, i.e.. direction DrB. 

This means that if a laser beam LS is driven contin- 
uously from the inside circumference to the outside cir- 
cumference on the first recording surface RSI . and then 
from the outside drcumference to the inside circumfer- 
ence on the second recording surface RS2. both skies 
of the recording medium RC3a can be read/written with- 
out turning the disk over and without provkling different 
laser beams for the two sides. 

The track paths for recording surfaces RS1 and 
RS2 ai'e also the same with this double-sided dual layer 
disk with asymmetrical track paths RC3a. As a result, it 
is also possible to read/Write both sides of the disk with- 
out providing separate laser beams for each side If the 
recording medium RC3a is tumed over between sides, 
and the read/Write apparatus can therefore be con- 
structed economically. 

It should be noted that this recording medium 
remains functionally identical even if counterclockwise 
recording track TRB is provided in place of clockwise 
recording track TRA on both recording surfaces RSI 
andRS2. 

As described above, the true value of a DVD sys- 
tem whereby the storage capacity of the recording 
medium can be easily increased by using a multiple 
layer recording surface is realized in multimedia applica- 
tions whereby plural video data units, plural audio data 
units, and plural graphics data units recorded to a single 
disk are reproduced through interactive operation by the 
user. 

It is therefore possible to achieve one long-standing 
desire of software (programming) providers, specifically, 
to provkJe programming content such as a commercial 
movie on a single recording medium in plural versions 
for different language and demographic groups while 
retaining the image quality of the original. 



is otsviously important, the programming content must 
also be consistently reproducible. 

The digital video disk recording medium is close to 
solving these problems. 

5 

Multiple angles 

One interactive operation widely sought in midtime- 
dia applications today is for the user to be able to 
10 change the position from which a scene is viewed dur- 
ing reproduction of that scene. This capability is 
achieved by means of the multiple angle function. 

This multiple angle function makes possible appli- 
catk>ns whereby, for example, a user can watch a base- 
15 ball game from different angles (or virtual positions in 
the stadium), and can freely switch between the views 
while viewing is in progress. In this example of a base- 
ball game, the available angles may include a position 
behind the t>ackstop centered on the catcher, batter, 
so and pitcher; one from behind the backstop centered on 
a fielder, the pitcher, and the catcher; and one from 
center field showing the view to the pitcher and catcher. 

To meet these requirements, the digital video disk 
system uses MPEG, the same basic standard format 
2S used with Video-Cds to record the vkleo, audio, graph- 
ics, and other signal data. Because of the differences in 
storage capacity, transfer rates, and signal processing 
performance within the reproduction apparatus. DVD 
uses MPEG2, the compression method and data format 
30 Of Which differ slightly from the MPEG1 fonnat used with 
Video-Cds. 

It should be noted tfiat the content of and differ- 
ences between the MPEGI and MPEG2 standards 
have no direct relationship to the intent of the present 
35 invention, and further description is therefore omitted 
below (for more information, see MPEG specificafions 
ISO-11172 and ISO-13818). 

The data structure of the DVD system according to 
the present invention is described in detail below with 
40 reference to Figs. 16, 17. 18, 19, 20, and 21. 

Multi-scene control 



Parental contrni 

Content providers of movie and video titles have 
conventionally had to produce, supply, and manage the 
inventory of individual titles in multiple languages, typi- 
cally the language of each distribution market, and 
multi-rated title packages conforming to the parental 
control (censorship) regulations of individual countries 
in Europe and North America. The time and resources 
required for this are significant. While high image quality 



A fully functional and practical parental lock play- 
45 back function and multi-angle scene playfc>ack function 
must enable tiie user to modify the system output in 
minor, subtle ways while still presenting substantially 
the same video and audio output. If these functions are 
achieved by preparing and recording separate tities sat- 
so isfying each of the many possifcrfe parental lock and 
multi-angle scene playl^ack requests, tities that are sub- . 
stantially identical and differ in only minor ways must be 
recorded to tine recording medium. This results in iden- 
tical data being repeatedly recorded to the larger part of 
55 the recording medium, and significantly reduces the uti- 
lization efficiency of the available storage capacity. More 
particularly, it is virtually impossible to record discrete 
titles satisfying every possible request even using the 
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massive capacity of the digital video disk medium. 
While it may be concluded that this problem can be eas- 
ily solved by increasing the capacity of the recording 
medium. tNs is an obviously undesirable solution when 
the effective use of available system resources is con- 5 
sidered. 

Using multi-scene control, the concept of which is 
described in another section below, in a DVD system, it 
is possible to dynamically construct titles for numerous 
variations of the same t^asic content using the smallest 10 
possible amount of data, and thereby effectively utilize 
the available system resources (recording medium). 
More specifically, titles that can be played back with 
numerous variations are constructed from basic (com- 
mon) scene periods containing data common to each is 
title, and multi-scene periods comprising groups of dif- 
ferent scenes corresponding to the various requests. 
During reproduction, the user is able to freely and at any 
time select particular scenes from the multi-scene peri- 
ods to dynamically construct a title conforming to the 20 
desired content. e.g.. a title omitting certain scenes 
using the parental lock control function. 

Note that multi-scene control enabling a parental 
lock playback control function and multi-angle scene 
playback is described in another section below with ref- 2s 
erencetoFig. 21. 

Data structure of the DVD system 

The data structure used in the authoring system of 30 
a digital videp disk system according- to the present 
invention is shown Jn Rg. 22. To record a multimedia bit- 
stream MBS, this digital video disk system divides the 
recording medium into three major recording areas, the 
lead-in area LI, the volume space VS« and the lead-out 3S 
area LO, 

The lead-in area LI is provkled at the iriside circum- 
ference area of the optical disk. In the disks described 
with reference to Rgs. 9 and 10. the lead-in area LI is 
positioned at the inside end points lA and IB of each 
track Data for stabilizing the operation of the reproduc- 
ing apparatus when reading starts is written to the lead- 
in area LI. 

The lead-out area LO is con-espondingly located at 
the outside circumference of the optical disk, i.e., at out- 4s 
side end points OA and OB of each track in the disks 
described with reference to Figs. 9 and 10. Data identi- 
fying the end of the volume space VS is recorded in this 
lead-out area LO. 

The volume space VS is located between the lead- so 
in area LI and lead-out area LO. and is recorded as a 
one-dimensional array of n+1 (where n is an integer 
greater than or equal to zero) 2048-byte logic sectors 
LS. The logic sectors LS are sequentially number #0, 
#1 . #2, ... #n. The volume space VS is also divided into ss 
a volume and file structure management area VFS and 
a file data structure area FDS. 

The volume and file structure-management area 



VFS comprises m+l logic sectors LS#0 to LS#m (where 
m is an integer greater than or equal to zero and less 
than ri. The file data structure FDS comprises n-m logic 
sectors LS #nn+1 to LS #n. 

Note that this file data structure area FDS corre- 
sponds to the multimedia bitstream MBS shown in Rg. 
1 arid described above. 

The volume file structure VFS is the file system for 
managing the data stored to the volume ^pace VS as 
fDes, and is divided into logic sectors LS#0 - LS#m 
where m is the number of sectors required to store all 
data needed to manage the entire disk, and is a natural 
number less than n. Information for the files stored to 
the file data structure area FDS is written to the volume 
file structure VFS according to a known specification 
such as lSO-9660 or ISO-13346. 

The file data structure area FDS comprises n-m 
logic sectors LS#m - LS#n. each comprising a video 
manager VMG sized to an integer multiple of the logic 
sector (2048 x I. where i is a known iriteger). and k video ; 
title sets VTS #1 - VTS#k (where k is a natural number 
less than 100). 

The video manager VMG stores the titie manage- 
rhent information for the entire disk, and information for 
txiilding a volume menu used to set and change repro- 
duction control of the entire volume. 

Any video title set VTS #k is also called a *Video 
file" representing a titie comprising video, audio, and/or 
still image data. 

The internal structure of each video title set VTS 
shown in Rg. 22 is shown in Fig. 16. Each video title set 
VTS comprises VTS information VTS I describing the 
management information for the entire disk, and the 
VTS titie video objects VOB (VTSTT_VOBS), i.e.. tiie 
system stream of the nrujjtimedia bitstream. The VTS 
information VTSI is described first below, followed by 
tile VTS title VOBS. ' ' 

The VTS information primarily includes the VTSI 
management table VTS^MAT and VTSPGG informa- 
tion table VTS.PGGIT, 

The VTSI management table VTS1_MAT stores 
sdch information as the internal structure of the video 
title set VTS. the number of selectable audio streams 
contained^ in the video title set VTS, he number of sub- 
pictures, and thV\Hde6 titie set VTS location (storage 
address). 

The VTSPGG information table VTS_PGCIT 
records i (where i is a natural number) program chain 
(PGG) data blocks VTS_PGGI #1 - VTS>GGI #i.for 
controlling the playback sequence. Each of tfie tablie 
entries VTS_PGCI #i is a data entry expressing the pro- 
gram chain, and comprises j (where j is a natural 
number) cell playback information blocks G^PBl #1 - 
G_PBI #j. Each ceil playback information block G_PBI #j 
contains the playback sequence of the cell and play- 
back control information; 

The program chain PGG is a conceptual structure 
describing the story of the titie content, and therefore 
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defines the structure of each title by desaibing the cell 
playback sequence. Note that these cells are described 
in detail below. 

If, for example, the video title set information relates 
to the menus, the video title set information VTSI is 
stored to a buffer in the playback device when playl^ack 
starts. If the user then presses a MENU button on a 
remote control'device, for example, during playback, the 
playback device references the buffer to fetch the menu 
information and display the top menu #1. If the menus 
are hierarchical, the main menu stored as program 
chain information VTS_PGCI #1 may be displayed, for 
example, by pressing the MENU button, VTS_PGCI #2 
- #9 may correspond to submenus accessed using the 
numeric keypad on the remote control, and VTS_PGCI 
#10 and higher may correspond to additional submenus 
further down the hierarchy Alternatively. VTS_PGCI #1 
may be the top menu displayed by pressing the MENU 
button, while VTS_PGCI ^ and higher may be voice 
guidance reproduced by pressing the corresponding 
numeric key. 

The menus themselves are expressed by the plural 
program chains defined in this table. As a result, the 
menus may be freely constructed in various ways, and 
shall not be limited to hierarchical or non-hierarchical 
menus or menus containing voice guidance. 

In the case of a movie, for example, the video title 
set information VTSI is stored to a buffer in the playback 
device when playback starts, the playback device refer- 
ences the cell playback sequence described by the pro- 
gram chain PGC. and reproduces the system stream. 

The "cells" referenced here may be all or part of the 
system stream, and are used as access points during 
playback. Cells can therefore be used, for example, as 
the "chapters" into which a title may be divided. 

Note that each of the PGC information entries 
C_PBI ^ contain both cell playback processing informa- 
tion and a cell information table. The cell playback 
proces^ng information comprises the processing infor- 
mation needed to reproduce the cell, such as the pres- 
entation time and number of repetitions. More 
speciffoally. this information includes the cell block 
mode CBM, cell block type OBT. seamless playback flag 
SPF, interleaved allocation flag lAF. STC resetting flag 
STCDF. cell presentation time C_PBTM, seamless 
angle change flag SACF. first cell VOBU start address 
C_FVOBU_SA. and the last cell VOBU start address 
C_LVOBU_SA. 

Note that seamless playback refers to the reproduc- 
tion in a digital video disk system of multimedia data 
including video, audio, and sub-picture data without 
intermittent breaks in the data or information. Seamless 
playback is described in detail in another section below 
with reference to Fig. 23 and Fig. 24. 

The cell block mode CBM indicates whether plural 
cells constitute one functional block. The cell playback 
information of each cell in a functional block is arranged 
consecutively in the PGC information. The cell block 




mode CBM of the first cell playback information in this 
sequence contains the value of the first cell in the t)lock. 
and the cell block mode CBM of the last cell playt^ack 
information in this sequence contains the value of the 
5 last cell in the block. The cell block mode CBM of each 
cell arrayed between these first and last cell^ contains a 
value indicating that the cell is a cell between these first 
and last cells in that block. 

The cell block type CBT identifies the type of the 
10 block indicated by the cell block mode CBM. For exam- 
ple, when a multiple angle function is enabled, the cell 
information corresponding to each of the reproducible 
angles is programmed as one of the functional blocks 
mentioned above, and the type of these functional 
rs blocks Is defined by a value identifying "angle" in the cell 
block type CBT for each cell in that block 

The seamless playback flag SPF simply indicates 
whether the corresponding cell is to be linked and 
played back seamlessly with the cell or cell block repro- 
20 duced immediately therebefore. To seamlessly repro- 
duce a given cell with the preceding cell or cell block, 
the seamless playback flag SPF is set to ) in the cell 
playback Information for that cell; othenwise SPF is set 
too. 

25 The interleaved allocation flag lAF stores a value 
identifying whether the cell exists In a contiguous or 
interleaved block. If the cell is part of an interleaved 
block, the flag lAF Is set to 1 ; otherwise it is set to 0. 
The STC resetting flag STCDF identifies whether 
30 the system time dock STC used for synchronization 
must be reset when the pell is played back; when reset- 
ting the system time ctock STC is necessary, the STC 
resetting flag STCDF is set to 1 , 

The seamless anglQ change flag SACF stores a 
35 value indicating whether a cell in a multi-angle period 
should be connected seamlessly at an angle change. If 
the angle change is seamless, the seamless angle 
change flag SACF is set to 1 ; othenwise it is set to 0. 
The cell presentation time C_PBTM expresses the 
40 cell presentation time with vkJeo frame precision. 

The first cell VOBU start address C_FVOBU_SA is 
the VOBU start address of the first cell in a block, and is 
also expressed as the distance from the logic sector of 
the first c^l in the VTS title VOBS (VTSTT^VOBS) as 
45 measured by the number of sectors. 

The last cell VOBU start address C_LVOBU_SA is 
the VOBU start address of the last cell in the block. The 
value of this address is expressed as the distance from 
the logic sector of the first cell in the VTS title VOBS 
so (VTSTr_VOBS) as measured by the number of sectors. 
The VTS title VOBS (VTSTT_VOBS). i.e.. the multi- 
media system stream data, is described next. The sys- 
tem stream data VTSTT_VOBS comprises i (where i is 
a natural number) system streams SS. each of which is 
55 referred to as a "video object" (VOB). Each video object 
VOB #1 - VOB #i comprises at least one video data 
t)lock interleaved with up to a maximum eight audio data 
tdlocks and up to a maximum 32 sub-picture data blocks. 
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Each video object VOB comprises q (where q is a 
natural number) cells C#1 - G#q. Each cell C comprises 
r (where r is a natural number) video object units VOBU 
#1 - VOBU #r. 

Each video object unit VOBU comprises plural 
groups_of_pictures GOP, and the audio and sub-pic^ 
tures corresponding to the playback of said plural 
groups_of__pictures GOR Note that the group- 
of_pictures GOP corresponds to the video encoding 
refresh cycle. Each video object unit VOBU also starts 
with an NV pacK i.e.. the control data for that VOBU. 

The structure of the navigation packs NV is 
described with reference to Fig. 18. 

Before describing the navigation pack NV. the inter- 
nal structure of the vkleo zone VZ (see Rg. 22). i.e., the 
system stream St35 encoded by the authoring encoder 
EC described with reference to Fig. 25, is described 
with reference to Rg. 17. Note that the encoded video 
stream St15 shown in Fig. 17 is the compressed one- 
dimensional video data stream encoded by the video 
encoder 300. The encoded audio stream St19 is like- 
wise the compressed one-dimensional audio data 
stream multiplexing the right and left stereo audio chan- 
nels encoded by the audio encoder 700. Note that the 
audio signal shall not be limited to a stereo signal, and 
may also be a multichannel surround-sound signal. 

The system stream (title editing unit VOB) St35 is a 
one dimensional array of packs with a byte size corre- 
sponding to the logic sectors LS #n having a 2048-byte 
capacity as described using Rg. 21. A stream control 
pack is placed at the beginning of the title editing unit 
(VOB) St35. i.e.. at the beginning of the video object unit 
VOBU. This stream control pack is called the "naviga- 
tion pack NV". and records the data arrangement in the 
system stream and other control information. 

The encoded video stream St15 and the encoded 
audio stream StIS are packetized in byte units corre- 
sponding to the system stream packs. These packets 
are shown in Fig. 17 as packets VI, V2. V3. V4... and 
A1, A2. A3.... As shown in Fig. 17, these packets are 
interleaved in the appropriate sequence as system 
stream St35, thus forming ^ packet stream, with consid- 
eration given to tiie decoder buffer size and the time 
required by the decoder to expand the video and audio 
data packets. In the example shown in Rg. 17. the 
packet stream is interleaved in the sequence VI. V2. 

A1,V3.V4.A2 

Note that the sequence shown in Fig. 17 inter- 
leaves one video data unit with one audio data unit Sig- . 
nificantly increased recording/k)layl>ack capacity, high 
speed recording/playback, and performance improve- 
ments in the signal processing LSI enable the DVD sys- 
tem to record plural audio data and plural sub-picture 
data (graphics data) to one video data unit in a single 
interleaved MPEG system stream, and thereby enable 
the user to select the specific audio data and siibiDic- 
ture data to be reproduced during playt)ack. The struc- 
ture of the system stream used ijv this type of DVD 



system is shown in Fig. 18 . and described below. 

As in Fig. 17, the packetized encoded video stream 
St15 is shown in Fig. 18 as VI. V2, VS. V4. ... In ttiis 
example, however, there is not just one encoded audio 

5 stream St19, txjt three encoded audio streams St19A, 
St19B. and StISC input as the source data. There are 
also two encoded sub-picture streams Sti 7A and Sti 7B 
input as the source data sub-picture streams. These six 
compressed data streams. Sti 5. St19A, St19B, St19C, 

10 St17A and St17B, are interleaved to a single system 
stream St35. 

The video data is encoded according to the MPEG 
specification with tine grpup_of_pictures GOP being the 
unit of compression. In general, each group_of_pictures 
75 GOP contains 1 5 f raimes in the case of an NTSC signal, 
but the ^ecific number of frames compressed to one 
GOP is variable: The stream management pack, which 
describes the management data containing, for exam- 
ple, the relationship between interleaved data, is also 
20 interleaved at tiie GOP unit interval. Because the 
group_of_pictures GOP unit is based on the video data, 
changing the number of video frames per GOP unit 
changes the interval of the stream management packs. 
This interval is expressed in terms of the presentation 
25 time on the digital video disk within a range from 0.4 
sec. to 1 .0 sec. referenced to the GOP unit If the pres- 
entation time of contiguous plural GOP units is less than 
. 1 sec. . the management data packs for the video data of 
the plural GOP units is interieaved to a single stream. 
30 These management data packs are referred to as 
navigation packs NV in the digital video disk system. 
The data from one navigation pack NV to the packet 
immediately preceding the next riavigation pack NV 
forms one video object unit VOBU. In general, one con- 
35 tiguous playt>ack unit that can be defined as one scene 
is. called a video object VOB, and each video object 
VOB contains pjural video object units VOBU. Data sets 
of plural video objects VOB form a VOB set (VOBS). 
Note that these data units were first used in the digital 
40 video disk. 

When plural of these data streams are interleaved, 
the navigation packs NV defining the relationship 
between tine interleaved packs must also be interleaved 
at a defined unit known as tiie pack number unit. Each . 
45 group_of jpictures GOP is normally a unit containing 
approximately 0.5 sec. of video data, which is equiva- . 
lent to the presentation time required for 1 2 - 1 5 frames; 
and one navigation pack NV is generally interleaved 
with the number of data packets required for this pres- 
so entationtime. 

The stream management information contained in 
the interleaved video, audio, and sub-picture data pack- 
ets constituting the system stream is desciibed below 
with reference to Rg. 19. As shown in Rg. 19, the data 
55 contained in the system stream is recorded in a format: 
packed or packetized according to the MPEG2 stand; 
ard. The packet struckire is essentially the sanrie for 
video, audio, and sub-picture data. One pack in the dig- 
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itai video disk system has a 2048 byte capacity as 
described above, and contains a pack header PKH and 
one packet PES; each packet PES contains a packet 
header PTH and data block 

"me pack header PKH records the time at which s 
that pack is to be sent from stream buffer 2400 to sys- 
tem decoder 2500 (see Fig. 26), i.e.. the system clock 
reference SCR d^ining the reference time for synchro- 
nized audio-visual data playback. The MPEG standard 
assumes that the system clock reference SCR is the ref- io 
erence clock for the entire decoder operation. With such 
disk media as the digital video disK however, time man- 
agement specific to individual disk players can be used, 
and a reference dock for the decoder system is there- 
fore separately provided. is 

The packet header PTH similarly contains a pres- 
entation time stamp PTS and a decoding time stamp 
DTS. both of which are placed in the packet before the 
access unit (the decoding unit). The presentation time 
stamp PTS defines the time at which the video data or 20 
audio data contained in the packet should be output as 
the playback output after being decoded, and the 
decoding time stamp DTS defines the time at whteh the 
video stream shoukJ be decoded. Note that the presen- 
tation time stamp PTS effectively defines the display 2s 
start timing of the access unit, and the decoding time 
stanp DTS effectively defines the decoding start timing 
of the access unit. If the PTS and DTS are the same 
time, the DTS is omitted. 

The packet header PTH also contains an 8-bit field 30 
called the stream ID identifying the packet type, i.e.. 
whether the packet is a video packet containing a video 
data stream, a private packet, or an MPEG audio 
packet 

Private packets under the MPEG2 standard are 3s 
data packets of which the content can be freely defined. 
Private packet 1 in this emtxxJiment of the invention is 
used to can^y audio data other than the MPEG audio 
data, and sub-picture data; private packet 2 carries the 
PCI packet and DSI packet. 40 

Private packets 1 and 2 each comprise a packet 
header, private data area, and data area. The private 
data area contains an 8-bit sub-stream ID indicating 
whether the recorded data is audio data or sub-picture 
data. The audio data defined by private packet 2 may be 4S 
defined as any of eight types #0 - #7 of linear PCM or 
AC-3 encoded data. Sub-picture data may be defined 
as one of up to 32 types #0 - #31 . 

The data area is the field to which data compressed 
according to the MPEG2 specification is written if the so 
stored data is video data; linear PCM. AC-3. or MPEG 
encoded data is written if audio data is stored; or graph- 
ics data compressed by rurtfength coding is written if 
sub-picture data is stored. 

MPEG2-compressed video data may be com- ss 
pressed by constant bit rate (CBR) or variable bit rate 
(VBR) coding. With constant bit rate coding, the video 
stream is input continuously to the videabuffer at a con- 



stant rate. This contrasts with variable bit rate coding in 
which the video stream is input intermittently to the 
video buffer, thereby making it possible to suppress the 
generation of unnecessary code. Both constant bit rate 
and variable bit rate coding can be used in the digital 
video disk system. 

Because MPEG video data Is compressed with var- 
iable length coding, the data quantity in each 
group_of_pictures GOP is not constant. The video and 
audio decoding times also differ, and the time-base rela- 
tionship between the video and audio data read from an 
optical disK and the time-base relationship between the 
video and audio data output from the decoder, do not 
miatch. The method of time-base synchronizing the 
video and audio data is therefore described in detail 
below with reference to Fig. 26, but is described briefly 
below based on constant bit rate coding. 

The navigation pack NV structure is shown in Rg. 
20. Each navigation pack NV starts with a pack header 
PKH, and contains a PCI packet and DSI packet. 

As described above, the pack header PKH records 
the time at which that pack is to be sent from stream 
buffer 2400 to system decoder 2500 (see Rg. 26 ), i.e.. 
the system clock reference SCR defining the reference 
time for synchronized audio-visual data playback. 

Each PCI packet contains PCI General Information 
(PCLGI) and Angle Information for Non-seamless play- 
back (NMSL^AGLO- 

The PCI General Information (PCIjGI) declares tiie 
display time of the first video frame (the Start PTM of 
VOBU (VOBU__S_PTM)). and the display time of the last 
video frame (End PTM of VOBU (VOBU_E_PTM)). in 
the corresponding video object unit VOBU with system 
clock precision (90 Khz). 

TTie Angle Information for Non-seamless playback 
(NMSL_AGLI) states the read start address of the cor- 
responding video object unit VOBU when the ang^e is 
changed expressed as the number of sectors from the 
beginning of the video object VOB. Becauise there are 
nine or fewer angles in this example, there are nine 
angle address declaration cells: Destination Address of 
Angle Cell #1 for Non-seamless playback 
(NMSL_AGL_C1_DSTA) to Destination Address of 
Angle Cell #9 for Non-seamless playback 
(NMSL_AGL_C9_DSTA). 

Each DSI packet contains DSI General Information 
(DSI_GI). Seamless Playback Information (SML_PBI), 
and Angle Infbnnation for Seamless playback 
(SML.AGU). 

The DSI General Information (DSI_GO declares tiie 
address of the last pack in the video object unit VOBU, 
i. e., tiie End Address for VOB (VOBU^EA). expressed 
as the number of sectors from the beginning of the 
video object unit VOBU. 

While seamless playback is described in detail 
later, it should be noted that the continuously read data 
units must be interieaved (multiplexed) at the system 
stream level as an interieaved unit ILVU in order to 
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seamlessly reproduce split or combined titles. Plural 
system streams interleaved with the interleaved unit 
ILVU as the smallest unit are defined as an interleaved 
block. 

The Seamless Playback Information (SML_PBI) is 
declared to seamlessly reproduce the stream inter- 
leaved with the interleaved unit ILVU as the smallest 
data unit, and contains an Interleaved Unit Flag (ILVU 
flag) identifying whether the corresponding video object 
unit VOBU is an interleaved block The ILVU flag indi- 
cates whether the video object unit VOBU is in an inter- 
leaved ttlock, and is set to 1 when it is. Othenmse the 
ILVU flag is set to 0. 

When a video object unit VOBU is in an interleaved 
block, a Unit END flag Is declared to indicate whether 
the video object unit VOBU is the last VOBU in the inter- 
leaved unit ILVU. Because the interleaved unit ILVU is 
the data unit for continuous reading, the Unit END flag 
is set to 1 ff the VOBU currently being read is the last 
VOBU in the interleaved unit ILVU. Othenfvise the Unit 
END flag is set to 0. 

An Interleaved Unit End Address (ILVU_EA) Identi- 
fying the address of the last pack in the ILVU to which 
the VOBU belongs, and the starting address of the next 
interleaved unit ILVU. Next Interleaved Unit Start 
Address (NTJLVU^SA). a/e also declared when a 
vkieo object unit VOBU is in an interleaved block. Both 
the Interleaved Unit End Address (ILVU_EA) and Next 
Interleaved Unit Start Address (NT_ILVU_SA) are 
expressed as the number of sectors from the navigation 
pack NV of that VOBU. 

When two system streams are seamlessly con- 
nected but the audio components of the two system 
streams are not contiguous, particularly immediately 
j before and after the seam, it is necessary to pause the 
I audio output to synchronize the audio and video compo- 
I nents of the system stream following the seam. Note 
i that non-contigupus audio may result from different 
audio signals being recording with the corresponding 
; video blocks. With an NTSC signal, for example, the 40 
j . video frame cycle is approximately 33. 33 msec while 
I the AC-3 audio frame cycle is 32 msec. 
I To enable this resynchronization. audio reproduc- 

tion stopping. times 1 and 2. i.e., Audio Stop PTM 1 in 
I VOB (VOB_A_STP_PTM1). and Audio Stop PTM2 in 45 
I VOB (VOB_A.STP_PTM2), indicating the time at which 
the audio is to be paused: and audio reproduction stop- 
i ping periods 1 and 2. i.e.. Audio Gap Length 1 in VOB 
j (VOB_A_GAP_LEN1) and Audio Gap Length 2 in VOB 
[ (VOB_A_GAP_LEN2). Indicating for how long the audio so 
I is to be paused, are also declared in the DSI packet 
Note that these times are specif led at the system clock 
precision (90 Khz). 

The Angle Information for Seamless playback 
(SML_AGLI) declares the read start address when the ss 
angle Is changed. Note that this field is valid when 
seamless, multi-angle control is enabled. This address 
Is also expressed as the number of sectors from the 




navigation pack NV of that VOBU. Because there are 
nine or fewer angles, there are nine angle address dec-, 
laration ceils: Destination Address of Angle Cell #1 for 
Seamless playback (SML_AGL_C1_DSTA) to Destina- 
5 tion Address of Angle Ceil #9 for Seamless playback 
(SML_AGL_C9_DSTA). 

Note also that each title is edited in video object 
(VOB) units. Interleaved video objects (interleaved title 
editing units) are referenced as "VOBS"; and the 
10 encoded range of the source data Is the encoding unit. . 

DVD encoder 

A preferred embodiment of a digital video disk sys- 
15 tem authoring encoder ECD in which the multimedia bit- 
stream authoring system according to the present 
invention is applied to a digital video disk system is 
described below and shown in Rg. 25. It will be obvious 
that the authoring encoder ECD applied to the digital 
20 video disk system, referred to below as a DVD encoder, 
is substantially identical to the authoring encoder EC 
shown in Fig. -2. The basic differerK:e between these 
encoders is the replacement in the DVD encoder ECD 
of the video zone formatter 1300 of the authoring 
25 encoder EC above with a VOB buffer 1000 and fprrhat- 
ter 1100. It yvill also be obvious that the bitstream 
encoded by this DVD encoder ECD is recorded to a dig- 
ital video disk medium M. The operation of this DVD 
encoder ECD is therefore described below In compari- 
30 son with the authoring encoder EC described above. 

As in the above authoring encoder EC. the encod- 
ing system controller 200 generates control signals St9. 
Stil. St13. St21. St23. St25. St33. and St39 teased on 
the scenario data St7 describing the user<lefined edit- 
35 ing instructions input from the scenario editor 100. and 
controls the video encoder 300, sub-picture encoder 
500. and audio encoder 700 in the DVD ehcoider ECD. 
Note that the user <lefined editing instructibris In the 
DVD encoder ECD are a superset of the editing Instruc- 
tions of the authoring encoder EC described above. 

Specifically, the user-defined editings instructions 
(scenario data StT) in the DVD encoder ECD similarly > 
describe what source data Is selected from all or a sub- 
set of the source data containing plural titles within a 
ddined time period, and how the selected source data 
Is reassembled to reproduce the scenark) (sequence) 
intended by the user. The scenario data St7 of the.DVD 
encoder ECD. however, further contains such informa- 
tion as: the number of streams contained in the editing 
units, which are obtained by splitting a multi-jitle source 
stream into blocks at a constant time interval; the 
number of audio and sub-picture data cells contained in 
each stream, and the subiDicture display time and 
period; whether the title is a multi-rated title enabling 
parental lock control; whether the user' content Is 
selected from plural streams Including, for example, 
multiple viewing angles; and the method of connecting 
scenes when the angle Is switched among the multiple 
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viewing angles. 

The scenario data St7 of the DVD encoder ECD 
also contains control information on a video object VOB 
unit basis. This information is required to encode the 
media source stream, and specifically includes such s 
information as whether there are multiple angles or 
parental control features. When multiple angle viewing 
is enabled, the scenario data St7 also contains the 
encoding bit rate of each stream considering data inter- 
leaving and the disk capacity, the start and end times of ic 
each control, and whether a seamless connection 
should be made between the preceding and following 
streams. 

The encoding system controller 200 extracts this 
information from the scenario data St7, and generates 75 
the encoding information table and encoding parame- 
ters required for encoding control. The encoding infor- 
mation table and encoding parameters are described 
with reference to Figs. 27, 28, and 29 below. 

The stream encoding data St33 contains the sys- 20 
tern stream encoding parameters and system encoding 
start and end timing values required by the DVD system 
to generate the VOBs. These system stream encoding 
parameters include the conditions for connecting one 
video object VOB with those before and after, the 2s 
number of audio streams, the audio encoding informa- 
tion and audio Ids, the number of sub-pictures and the 
sub-picture Ids, the video playt>ack starting time infor- 
mation VPTS, and the audio playback starting time 
information APTS. 30 

The title sequence control signal St39 supplies the 
multimedia bitstream MBS formatting start and end tim- 
ing information and formatting parameters declaring the 
reproduction conti-ol information and interleave informa- 
tion. 35 

Based on the video encoding parameter and 
encoding start/end timing signal St9. the video encoder 
300 encodes a specific part of the video stream Sti to 
generate an elementary sti-eam conforming to the 
MPEG2 Video standard defined in ISO-13818. This ele- 40 
mentary stream is output to the video stream buffer 400 
as encoded video stream Sti 5. 

Note that while the video encoder 300 generates an 
elementary stream conforming to the MPEG2 Video 
standard defined in ISO-13818, specific encoding 45 
parameters are input via the video encoding parameter 
signal StS. Including the encoding start and end timing, 
bit rate, the encoding conditions for the encoding start 
and end. the material type, including whetfier the mate- 
rial Is an NTSC or PAL video signal or telecine con- so 
verted material, and whether tiie encoding mode Is set 
for either open GOP or dosed GOP encoding. 

The MPEG2 coding method is basically an inter- 
frame coding method using the correlation between 
frames for maximum signal compression, i.e.. the frame 55 
being coded (the target frame) is coded by referencing 
frames before and/or after the target frame. However, 
intra-coded frames. I. e. , frames that are coded based 



solely on the content of the target frame, are also 
) inserted to avoid error propagation and enable accessl- 
l bility from mid-stream (random access). The coding unit 
} containing at least one intra-coded frame fintra-frame") 
I 5 is called a group_of jwctures GOR 
r A group_of jDictures GOP in which coding is dosed 

I completely within that GOP is known as a "closed GOP." 
' A group_of_pictures GOP containing a frame coded 
with reference to a frame in a preceding or following 
f w (ISO-13818 DOES NOT LIMIT P- and B-picture COD- 
I INQ to referendng PAST frames) group_of__pictures 
GOP is an "open GOP." It is tiierefore possible to play- 
back a closed GOP using only that GOR Reproducing 
an open GOP. however, also requires the presence of 
IS the referenced GOP. generally the GOP preceding the 
open GOP. 

The GOP Is often used as tiie access unit. For 
example, the GOP may be used as the playback start 
point for reproducing a title from the middle, as a transi- 
20 tion point in a movie, or for fast-forward play and other 
special reproduction modes. High speed reproduction 
can be achieved in such cases by reproducing only the 
intra-frame coded frames in a GOP or by reproducing 
only frames in GOP units, 
2S Based on the sub^picture stream encoding parame- 
ter signal St 11. the sub-picture encoder 500 encodes a 
specific part of the sub-picture stream St3 to generate a 
variable length coded bitstream of bitmapped data. This 
variable lengtii coded bitstream data is output as tiie 
30 encoded sub-picture stream Sti 7 to the sub-picture 
stream buffer 600. 

Based on the audio encoding parameter signal 
Sti 3, the audio encoder 700 encodes a spedfic part of 
tiie audio stream StS to generate the encoded audio 
35 data. This encoded audio data may be data based on 
tiie MPEG1 audio standard defined in lSO-11172 and 
the MPEG2 audio standard defined in ISO-13818, AC-3 
audio data, or PCM (LPCM) data. Note that the meth- 
ods and means of encoding audio data according to 
40 these standards are known and commonly available. 

The video stream buffer 400 is connected to the 
video encoder 300 and to the encoding system control- 
ler 200. The video stream buffer 400 stores the encoded 
video stream Sti 5 input from the video encoder 300. 
45 and outputs the stored encoded video stream Sti 5 as 
the time-delayed encoded video stream St27 based on 
ttie timing signal St21 supplied from the encoding sys- 
tem controller 200, 

The sub-picture stream buffer 600 is similarly cdn- 
so nected to the sub-picture encoder 500 and to the encod- 
ing system controller 200. The sub-pidure stream buffer 
600 stores the encoded sub-picture stream Sti 7 input 
from the sub-picture encoder 500. and then outputs the 
stored encoded sut)-pidure stream St17 as time- 
55 delayed encoded sub-picture stream St29 based on ttie 
timing signal St23 supplied from the encoding system 
controller 200. 

The audio sti-eam buffer 800 is similarly connected 
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to the audio encoder 700 and to the encoding system 
controller 200. The audio stream buffer 800 stores the 
encoded audio stream Str9 input from the audio 
encoder 700. and then outputs the encoded audio 
stream St19 as the time-delayed encoded audio stream 5 
St31 t^sed on the timing signaj St25 supplied from the 
encoding system controller 200. 

The system encoder 900 is connected to the video 
stream txiffer 400, sut>-picture stream buffer 600. audio 
stream buffer 800. and the encoding system controller 10 
200, and is respectively supplied thereby with the time- 
delayed encoded video stream St27, time-delayed 
encoded sub-picture stream St29, time-delayed 
encoded audio stream St31, and the system stream 
encoding parameter data St33. Note that the system is 
encoder 900 is a multiplexer that multiplexes the time^ 
delayed streams St27, St29. and St31 based on the 
stream encoding data St33 (tinting signal) to generate 
title editing units (VOBs) St35. 

The VOB buffer 1000 temporarily stores the video 20 
objects VOBs produced by the system encoder 900. 
The formatter 1100 reads the delayed video objects 
VOB from the VOB buffer 1000 based on the title 
sequence control signal St39 to generate one video 
zone VZ. and adds the volume file structure VFS to gen- . 2s 
erate the edited multimedia stream data St43. 

The multimedia bitstream MBS St43 edited accotxl- 
ing to the user-defined scenario Is then sent to the 
recorder 1 200. The recorder 1 200 processes the edited 
multimedia stream data St43 to the data stream St45 - 30 
format of the recording medium M. and thus records the 
formatted data stream St45 to the recording medium M. 

DVD decoder 

35 

A preferred.embodiment of a digital Video disk sys- 
tem authoring decoder DCD in which the multimedia bit- 
stream authoring system of the present invention is 
applied to a digital video disk system is described below 
and shown in Fig. 26? The authoring decoder DGD 40 
applied to the digital video disk system, referred to 
below as a DVD decoder DCD, decodes the multimedia 
bitstream MBS edited using the DVD encoder ECD of 
the present invention, and recreates the content of each 
title according to the user-defined scenario. It will also 4S 
be obvious that the multimedia bitstream St45 encoded 
by this DVD encoder ECD is recorded to a digital video 
disk medium M. 

The basic configuration of the DVD decoder DCD 
according to this embodiment is the same as that of the so 
authoring decoder DC shown in Rg. 3. The differences 
are that a different video decoder 3801 (shown as 3800 
In Rg. 26) is used in place of the video decoder 3800. 
and a reordering txiffer 3300 and selector 3400 are dis- 
posed betwe^ the video decoder 3801 and synthesizer ss 
3500. 

Note that the selector 3400 is connected to the syn- 
chronizer 2900, and is controlled by a switching signal 



St103. 

The operation of this DVD decoder DCD is there- 
fore described below in comparison with the authoring 
decoder DC described above. 

As shown in Fig. 26. the DVD decoder DCD com- 
prises a multimedia bitstream producer 2000, scenario 
selector 2100, decoding system controller 2300, stream 
Ixjffer 2400. system decoder 2500, video buffer 2600. 
sub-picture buffer 2700, audio buffer 2800. synchronizer 
2900, video decoder 3801 , reordering kxjffer 3300, sub- 
picture decoder 3100. audio decoder 3200, selector 
3400, synthesizer 3500. video data output terminal 
3600, and audio data output terminal 3700. 

The bitstream producer 2000 comprises a record- 
ing rnedia drive unit 2004 for driving the recording 
medium M; a reading head 2006 for reading the infor- 
mation recorded to the recording medium M and pro- 
ducing the binary read signal St57; a signal processor 
2008 for variously processing the read signal St57 to 
generate the reproduced bitstream StSI; and a repro- 
duction controller 2002. 

The reproduction controller 2002 is connected to 
the decoding system controller 2300 from which the 
multimedia bitstream reproduction control signal St53 is 
supplied, and in turn generates the reproduction control 
signals St55 and St59 respectively controlling tiie 
recording media drive unit (motor) 2004 and signal 
processor 2008. 

So that ttie user-defined video, sub-picture, and 
audio portions of the multimedia titie edited by the 
authoring encoder EC are reproduced, the autiioring 
decoder DC comprises a scenario selector 2100 for 
selecting and reproducing the corre^x)nding scenes 
(titles). The scenario selector 2100 then outputs the 
selected tities as scenario data to the DVD decoder 
DCD. 

The scenario selector 2i00 preferably comprises a 
keytx)ard. CPU. and monitor. Using the keyboard, the 
user then inputs the desired scenario based on the con- 
tent of the scenario input'by the DVD encoder ECD/ 
Based on tiie keyboard input the CPU generates the 
scenario selection data St51 specifying the selected 
scenario. The scenario selector 2100 is connected to 
the decoding system controller 2300 by an infrared 
communications device, for example, and inputs the 
generated scenario selection data St51 to the decoding 
system controller 2300. ^ 

TTie stream buffer 2400 has a specific buffer capac- 
ity used to tenporarily store the reproduced bitstream 
St61 input from the bitstream producer 2000, extract tiie 
volume file structure VPS. the initial synchronization 
data SCR (system dock reference) in each pacK and 
the VOBU control information (DSI) in the navigation 
pack NV, to generate the bitstream control data St63. 
The stream txiffer 2400. is also connected to the decod- ' 
ing system controller 2300. to which it supplies the gen- 
erated bitstream control data St63. 

Based on the scenario selection data St51 supplied 
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by the scenario selector 2100. the decoding system 
controller 2300 then generates the bitstream reproduc- 
tion control signal St53 controlling the operation of the 
bitstream producer 2000. The decoding system control- 
ler 2300 also extracts the user-defined playback instruc- 5 
tion data from the bitstream reproduction control signal 
St53. and generates the decoding information table 
required for decoding control. This decoding information 
table IS described further below with reference to Figs. 
45 and 46. The decoding system controller 2300 also w 
extracts the title information recorded to the optical disk 
M from the file data structure area FOB of the bitstream 
control data St63 to generate the title information signal 
St200. Note that the extracted title information includes 
the video manager VMG. VTS information VTSI, the ,5 
PGC information entries C_PBI #j. and the cell presen- 
tation time C_PBTM. 

Note that the bitstream control data St63 is gener- 
ated In pack units as shown in Fig. 19, and is SMpplied 

from the stream buffer 2400 to the decoding system 20 
controller 2300, to which the stream buffer 2400 is con- 
nected. 

The synchronizer 2900 is connected to the decod- 
ing system controller 2300 from which it receives the 
system dock reference SCR contained in the synchroni- 25 
zation control data StSI to set the internal system clock 
STC and supply the reset system dock St79 to the 
decoding system controller 2300. 

Based on this system clock St79. the decoding sys- 
tem controller 2300 also generates the stream read sig- so 
nal St65 at a specific interval and outputs the read 
signal St65 to the stream buffer 2400. Note that the read 
unit in this case is the pack. 

The method of generating the stream read signal 
St65 is described next. 35 

The decoding system controller 2300 compares the 
system dock reference SCR contained in the stream 
contrd data extracted from the stream buffer 2400 with 
the system dock St79 supplied from the synchronizer 
2900. and generates the read request signal St65 when 40 
the system clock St79 is greater than the system dock 
reference SCR of the bitstream control data St63. Pack 
transfers are controlled by executing this control proc- 
ess on a pack unit. 

Based on the scenario selection data St51. the 45 
decoding system controller 2300 generates the decod- 
mg signal St69 defining the stream Ws for the video 
sub-picture, and audk> bitstreams corresponding to the 
selected scenario, and outputs to the system decoder 
2500. ^ 

50 

When a title contains plural audio tracks, e.g., audio 
tracks in Japanese. English. French, and/or other lan- 
guages, and plural sub-picture tracks for subtitles in 
Japanese. English. French, and/or other languages, for 
example, a discrete ID is assigned to each of the Ian- 55 
guage tracks. As described above with reference to Fig. 
1 9. a stream ID is assigned to the video data and MPEG 
audio data, and a substream ID Is assigned to the sub- 



picture data. AC-3 audio data, linear PCM data, and 
navigation pack. NV information. While the user need 
never be aware of these ID numbers, the user can 
select the language of the audio and/or subtitles using 
the scenario selector 2100. If English language audio is 
selected, for example, the ID corresponding to the Eng- 
lish audio track is sent to the decoding system controller 
2300 as scenario selection data St51. The decoding 
system controller 2300 then adds this ID to the decod- 
ing signal St69 output to the systern decoder 2500. 

Based on the instructions contain^ in the decod- 
ing signal St69, the system decoder 2500 respectively 
outputs the video, sub-picture, and audio bitstreams 
input from the stream buffer 2400 to the video Ixjffer 
2600. sub-picture buffer 2700. and audio buffer 2800 as 
the encoded video stream St71, encoded sub-picture 
stream St73, and encoded audio stream St75. Thus, 
when the stream ID input from the scenario selector 
2100 and the pack ID input from the stream buffer 2400 
match, the system decoder 2500 outputs the corre- 
sponding packs to the respective buffers (i.e.. the video 
buffer 2600. sub-picture buffer 2700, and audio buffer 
2800). 

The system decoder 2500 deteds the presentation 
time stamp PTS and decoding time stamp DTS of the 
smallest control unit in each bitstream St67 to generate 
the time information signal St77. This time information 
signal St77 is supplied to the synchronizer 2900 through 
the decoding system contrdler 2300 as the syndironi- 
zation contrd data St81 . 

Based on this synchronization control data St81, 
the synchronizer 2900 determines the decoding start 
timing whereby each of the bitstreams will be arranged 
in the correct sequence after decoding, and then gener- 
ates and inputs the video stream decoding start signal 
St89 to the video decoder 3801 based on this decoding 
timing. The synchronizer 2900 also generates and sup- 
plies the sub-picture decoding start signal St91 and 
audio stream decoding start signal St93 to the sub-pic- 
ture decoder 3100 and audio decoder 3200. respec- 
tively 

The video decoder 3801 generates the video output 
request signal St84 based on the video stream decod- 
ing start signal St89. and outputs to the vWeo buffer 
2600. In response to the video output request signal 
St84. the video buffer 2600 outputs the video stream 
St83 to the video decoder 3801. The video decoder 
3801 thus detects the presentation time information 
contained in the video stream St83. and disables the 
video output request signal St84 when the length of the 
received video stream St83 is equivalent to the speci- 
fied presentation time. A video stream equal in length to 
the specified presentation time is thus decoded by tiie 
video decoder 3801. which outputs the reproduced 
video signal St95 to the reordering buffer 3300 and 
selector 3400. 

Because the encoded video stream is coded using 
the interframe correlations between pictures, the coded 
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order and display order do not necessarily match on a 
frame unit basis. The video cannot, therefore, be dis- 
played in the decoded order. The decoded frames are 
therefore temporarily stored to the reordering buffer 
3300. The synchronizer 2900 therefore controls the 5 
switching signal St 103 so that the reproduced video sig- 
nal St95 output from the video decoder 3800 and the 
reordering buffer output St97 are appropriately selected 
and output in the display order to the synthesizer 3500. 

The sub-picture decoder 3100 similarly generates 10 
the sub-picture output request signal St86 based on the 
sub-picture decoding start signal StSI. and outputs to 
the sub-picture buffer 2700. In response to the sub-pic- 
ture output request signal St86. the sub-picture buffer 
2700 outputs the sub-picture stream .St85 to the sub- is 
picture decoder 3100. Based on the presentation time 
information contained in the sub-picture stream St85. 
the sub-picture decoder 3100 decodes a length of the 
sub-picture stream St85 con-esponding to the specified 
presentation time to reproduce and supply to the syn- 20 
thesizer 3500 the sub-picture signal St99. 

The synthesizer 3500 superimposes the selector 
3400 output with the sub-picture signal St99 to generate 
and output the video signal Sti 05 to the video data out- 
put terminal 3600. 25 

The audio decoder 3200 generates and supplies to 
the audio buffer 2800 the audio output request signal 
St88 based on the audio stream decoding start signal 
St93. The audio buffer 2800 thus outputs the audio 
stream St87 to the audio decoder 3200. The audio 30 
decoder 3200 decodes a lengtii of the audio stream 
St87 corresponding to the specified presentation time 
based on the presentation time information contained in 
the audio stream St87. and outputs the decoded audio 
stream Stl 01 to the audio data output terminal 3700. 35 

It is thus possitrfe to reproduce a user-defined mul- 
timedia bitstream MBS in real-time according to a user- . 
defined scenario. More specifically, each time the user 
selects a different scenario, the DVD decoder DCD is ' 
able to reproduce the titie content desired by the user in 40 
the desired sequence by reproducing tfie multimedia 
bitstream MBS corresponding to the selected scenario. 

It should be noted tfiat the decoding system control- 
ler 2300 may supply the titie information signal St200 to 
the scenario selector 2100 by means of the infrared 4S 
cornmunications device mentioned, above or another 
means. Interactive scenario selection controlled by the 
user can also be made possible by the scenario selector 
2100 extracting the title information recorded to the opti- 
cal disk M from tfie file data structure area FDS of the so 
bitstream control data St63 contained in the titie infor- 
mation signal St200. and displaying this title information 
on a display for user selection. 

Note, further, tiiat ttie sti-eam buffer 2400. video 
buffer 2600. sub-picture buffer 2700. audio buffer 2800, ss 
and reordering buffer 3300 are expressed above and in 
the figures as separate entities because they are func- 
tionally different. It will be obvious, however, that a sin- 



gle buffer memory can be controlled to provide tiie 
same discrete functionality by time-share controlled use 
of a Ixiffer memory with an operating speed plural times 
faster than tiie read arid write rates of these separate 
buffers. 

Multi-scene control 

The concept of multiple angle scene control accord- 
ing to tiie preserrt invention is described below witii ref- 
erence to Fig. 21 . As described above, titles that can be 
played back with numerous variations are constructed 
from basic scene periods containing data common to 
each titie. and multi -scene periods comprising groups of 
different scenes corresponding to the various scenario 
requests. In Fig. 21 , scenes 1 . 5, and 8 are the common 
scenes of the basic scene periods. The multi-angle 
scenes (angles 1, 2. and 3) between scenes 1 and 5. 
and the parental locked scenes (scenes 6 and 7) 
between scenes 5 and 8. are the multi-scene periods. 

Scenes taken from different angles, i.e., angles 1, 
2. and 3 in this example, can be dynamically selected 
and reproduced during playback in the multi-angle 
scene period. In tiie parental locked scene period, how- 
ever, only one of the available scenes, scenes 6 and 7. 
having different content can be selected, and must be 
selected statically before playback begins. 

Which of these scenes from the multi-scene peri- 
ods is to be selected and reproduced is defined by the 
user operating the scenario selector 2100 and ttiereby 
generating the scenario selection data St51. In scenario 
1 in Fig. 21 the user can freely select any of the multi- 
angle scenes, and scene 6 has been preselected for 
output in the parental locked scene period. Similariy in 
scenario 2. the user can freely select any of the multi- 
angle scenes, and scene 7 has been preselected for 
output in the parental locked scene period. 

Witii reference to Figs. 30 and 31 . furthernK>re, the 
contents of tiie program chain information VTS_PGCI is 
described. In Fig. 30, tiie case tiiat a scenario 
requested by the user is shown with respect to a VTSI 
data construction. The scenario 1 and scenario 2 shown 
in Fig, 21 are described as program chain information 
VTS_PGC#1 and VTS_PGC#2. VTS_PGC#1 describ- 
ing the scenario 1 consists of cell playback information 
C_PBI#1 corresponding to scene 1, C_PBI#2. 
G_PBI#3, aind C_PBI#4 wittiin a multi-angle cell block, 
C_PBI#5 corresponding to scene 5, C_PBI#6 corre- 
sponding to scene 6. and C_PBI#7 con-esponding to 
scene 8. 

VTS_PGCI#2 describing the scenario 2 consists of 
cell playback, information C_PBI#1 corresponding to 
scene 1. C_PBI#2, C_PBI#3. and C.PBI#4 within a 
multi-angle cell block corresponding to a multi-angle 
scene, C_PBI#5 corresponding to scene 5. C_PBI#6 
corresponding to scene 7. and C_PBI#7 corresponding 
to scene 8. According to tiie digital video system data 
structure, a scene which is a control unit of a scenario is 



21 



41 



EP 0 847 195 A1 



42 



described as a cell which is a unit thereunder, thus a 
scenario requested by a user can be obtained. 

In Fig. 31 , the case that a scenario requested by the 
user shown in Fig. 21 is shown with respect to a VOB 
data construction VTSTT_VOBS. As specifically shown s 
in Fig. 31, the two scenarios 1 and 2 use the same VOB 
data in common. With respect to a single scene com- 
monly owned by each scenario. VOB#1 corresponding 
to scene 1, VOB#5 corresponding to scene 5, and 
VOB#8 corresponding to scene 8 are ananged in non- io 
interleaved block which is the contiguous block 

With respect to the multi-angle data commonly 
owned by scenarios 1 and 2. one angle scene data is 
constructed by a single VOB. Specifically speaking, 
angle 1 is constructed by VOB#2. and angle 2 is con-:, is 
structed by VOB#3. angle 3 is constructed by VOB#4. 
Thus constructed multi-angle data is formed as the 
interleaved block for the sake of switching between each 
angle and seamless reproduction of each angle data. 
Scenes 6 and 7 peculiar to scenarios 1 and 2, respec- 20 
lively, are formed as the interleaved block for the sake of 
seamless reproduction between common scenes 
before and behind thereof as well as seamless repro- 
duction between each scene. 

As described in the above, the user's requesting 25 
scenario shown in Rg. 21 can be realized by utilizing 
the video title playback control information shown in Fig. 
30 and the title playback VOB data structure shown in 
Fig. 31. 

30 

Seamless playback 

The seamless playback capability briefly mentioned 
above with regard to the digital video disk system data 
structure is described below. Note that seamless play- 3S 
back refers to the reproduction in a digital video disk 
system of multimedia data including video, audio, and 
sub-picture data without intermittent breaks in the data 
or information between basic scene periods, between 
basic scene periods and multi-scene periods, and 40 
between multi-scene periods. 

Hardware factors contributing to intermittent play- 
back of tills data and titie content include decoder 
underflow. i.e., an imbalance between the source data 
input speed and the decoding speed of the input source 4S 



Other factors relate to the properties of the play- 
back data. When tiie playback data Is data tiiat must be 
continuously reproduced for a constant time unit in 
order for the user to understand the content or tnforma- so 
tion, e.g.. audio data, data continuity is lost when the 
required continuous presentation time cannot be 
assured. Reproduction of such information whereby the 
required continuity is assured is referred to as "contigu- 
ous information reproduction." or "seamless information ss 
reproduction." Reproduction of tiiis information when 
the required continuity cannot be assured is referred to 
as "non-continuous information reproduction." or "non- 



seamless Information reproduction." It is obvious that 
continuous information reproduction and non-continu- 
ous information reproduction are, respectively, seam- 
less and non-seamless reproduction. 

Note that seamless reproduction can be further cat- 
egorized as seamless data reproduction and seamless 
information reproduction. Seamless data reproduction 
is defined as preventing physical blanks or interruptions 
in the data playback (intermittent reproduction) as a 
result of a buffer underflow state, for example. Seam- 
less information reproduction is defined as preventing 
apparent interruptions in the information when per- 
ceived by the user (intermittent presentation) when rec- 
ognizing information from tiie playback data where 
tiiere are no actual physical breaks in the data repro- 
duction. 

Details of Seamless plavback 

The specific method enabling seamless reproduc- 
tion as thus described is described later below with ref- 
erence to Figs. 23 and 24. 

tnterieavino 

The DVD data system streams described above are 
recorded using an appropriate authoring encoder EC as 
a movie or other multimedia title on a DVD recording 
medium. Note that the following description refers to a 
movie as the multimedia titie being processed, but it will 
be obvious that the invention shall not be so limited. 

Sipplying a single movie in a format enabling the 
movie to be used in plural different cultural regions or 
count- ies requires the script to be recorded in the vari- 
ous languages used in tiiose regions or countries. It 
may even necessitate editing the content to conform to 
tfie mores and moral expectations of different cultures. 
Even using such a large-capacity storage system as tiie 
DVD system, however, it is necessary to reduce the bit 
rate, and therefore the image quality, if plural full-length 
tities edited from a single common source title are 
recorded to a single disk. This problem can be solved by 
recording the common parts of plural titles only once, 
and recording the segments different in each titie for 
each different titie only. This metiiod makes it possible 
to record plural tities for different countries or cultures to 
a single optical disk without reducing the twt rate, and. 
therefore, retaining high image quality. 

As shown in Fig. 21. ttie tities recorded to a single 
optical disk contain basic scene periods of scenes com- 
mon to all scenarios, and multi-scene periods contain- 
ing scenes specific to certain scenarios, to provide 
parental lock control and multi-angle scene control func- 
tions. 

In tfie case of the parental lock control function, 
titles containing sex scenes, violent scenes, or other 
scenes deemed unsuitable for children, i.e.. so-called 
"adult scenes," are recorded witii a combination of com- 
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mon scenes, adult scenes, and children's scenes. 
These title streams are achieved by arraying the adult 
and children's scenes to multi-scene periods between 
the common basic scene periods 

Multi-angle control can be achieved in a conven- 
tional single-angle title by recording plural multimedia 
scenes obtained by recording the subjects from the 
desired plural camera angles to the multi-scene periods 
arrayed between the common l)asic scene periods. 
Note, however, that while these plural scenes are 
described here as scenes recorded from different cam- 
era angles (positions), it will be obvious that the scenes 
may be recorded from the same camera angle but at dif- 
ferent times, data generated by computer graphics, or 
other video data. 

When data is shared between different scenarios of 
a single title, it is ofcn/tously necessary to move the laser 
beam LS from the common scene data to the non-com- 
mon scene data during reproduction, i.e., to move the 
optical pickup to a different position on the DVD record- 
ing medium RGl. The problem here is that the time 
required to move the optical pickup makes it difficult to 
continue reproduction without creating breaks in the 
audio or video, i.e., to sustain seamless reproduction. 
This problem can be theoretically solved by providing a 
track buffer (stream buffer 2400) to delay data output an 
amount equivalent to the worst access time. In general, 
data recorded to an optical disk is read by the optical 
pickup, appropriately processed, and temporarily stored 
to the track buffer. The stored data is subsequently 30 
decoded and reproduced as video or audio data. 

Definition of Interleaving 

To thus enable the user to selectively excise scenes ' 35 
and choose from among plural scenes, a state wherein 
non-selected scene data is recorded inserted betwei^n 
common scene data and selective scene data neces- 
sarily occurs because the data units associated with 
individual scenes are contiguously recorded to the 
recbrcling tracks of the recording medium. If data is then 
read in the . recorded sequence, non-selected scene 
data must be accessed before accessing and decoding 
the selected scene data, and seamless connections 
with the selected scene is difficult. The excellent ran- 
dom access characteristics of the digital video disk sys- 
tem, however, make seamjess connections with the 
selected scenes possible! 

In other words, by splitting scene-specific data into, 
plural units of a specified data size, and interleaving plu- 
ral split data units for different scenes in a predefined 
sequence that is recorded to disk within tfie jumping 
range whereby an data underflow state does not occur, 
it is possible to reproduce the selected scenes without 
data interruptions by intermittently accessing and 
decoding the data specific to the selected scienes using 
these ^lit data units. Seamless data reproduction is 




Interleaved block and Interleave unit 

The interleaving method enabling seamless data 
reproduction according to the present invention is 
5 described below with reference to Fig. 24 and Fig. 57. 
Shown in Fig. 24 is a case from which three scenarios 
may be derived, i.e., branching from one video object 
VOB-A to one of plural video objects VOB-B. VOB-C, 
and VOB-D. and then merging back again to a single 
10 video object VOB-E. The actual arrangement of these 
blocks recorded to a data recording track TR on disk is 
shown in Rg. 57. 

Refen-ing to Rg. 57. VOB-A and VOB-E are video 
objects with independent playback start and end times, 
IS and are in principle arrayed to contiguous block regions. 
As shown in Fig. 24, the playback start and end times of 
VOB-B, VOB-C. and VOB-D are aligned during inter- 
leaving. The interleaved data blocks are then recorded 
to disk to a contiguous interleaved t)lock region. The 
20 contiguous block regions and interleaved block regions 
are then written to disk in the track path Dr direction in 
the playback sequence. Plural video objects VOB. i.e., 
interieaved video objects VOBS, arrayed to the data* 
recording track TR are shown in Fig. 57. 
25 Refemng to Rg. 57. data regions to which data is 
continuously an-ayed are called "blocks." of which there 
are two types: "contiguous block regions" in which VOB 
with discrete starting and end points are contiguously 
an^ayed. and "interleaved block regions" in which plural 
VOB with aligned starting and end points are inter- 
leaved. The respective blocks are arrayed as shown in 
Rg. 58 in the playback sequence, i.e.. block 1. block 2, 

block 3 block 7. 

As shown in Fig. 58. the VTS title VOBS 
(VTSTT^VOBS) consist of t>locks 1 - 7, inclusive. Block 
1 contains VOB 1 alone. Blocks 2. 3, 5. and 7 similarly 
discretely contain VOBS 2, 3. 6. and 10. Blocks 2, 3, 5, 
and 7 are thus contiguous block regions. 

Block 4. however, contains VOB 4 and VOB 5 inter-. 
40 leaved together, while block 6 contains VOB 7, VOB 8, 
and VOB 9 interleaved together. Blocks 4 and 6 are thus 
interleaved block regions. 

The internal data structure of the contiguous block 
regions is shown in Fig. 59 with VOB-i and VOB-j 
45 arrayed as the contiguous blocks in tfie VOBs. As 
described with reference to Rg. 16. VOB-i and VOB-j 
inside tfie contiguous block regions are further logically 
divided into cells as the playback unit. Both VOB-i and 
VOB|-j in this figure are shown comprising three cells 
50 CELL #1 . CELL #2. and CELL #3. 

Each cell comprises one or more video object unit 
VOBU with the video object unit VOBU defining the 
kx)undaries of the cell. Each cell also contains informa- 
tion identifying the position of the cell in the program 
55 chain PGC (the playback control information of the dig- 
ital video disk system). More specifically, this position 
information is the address of the first and last VOBU in 
the cell. As also shown in Fig. 59, these VOB and the 
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cells defined therein are also recorded to a contiguous 
block region so that contiguous blocks are contiguously 
reproduced. Reproducing these contiguous blocks is 
therefore no problem. 

The internal data structure of the interleaved block 
regions is shown in Fig. 60. In the interleaved block 
regions each video object VOB is divided into inter- 
leaved units ILVU, and the interleaved units ILVU asso- 
ciated with each VOB are alternately arrayed. Cell 
boundaries are defined independently of tfie interleaved 
units ILVU. For example. VOB-k is divided into four inter- 
leaved units ILVUkl. ILVUk2, ILVUk3. and ILVUk4, and 
are confined by a single cell CELL#k VOB-k is likewise 
divkjed into four interleaved units ILVUmI, ILVUm2, 
ILVUmS, and ILVUm4. and is confined by a sincle cell 
CELL#m. Note that instead of a single cell CELL#k or 
CELL#m. each of VOB-k and VOB-m can be divided 
into more than two cells. The interleaved units ILVU thus 
contains both audio and video data. 

In the example shown in Fig. 60, the interleaved 
units ILVUkl. ILVUk2. ILVUkS. and ILVUk4. and 
ILVUmI . ILVUm2. ILVUm3. and ILVUm4. from two dif- 
ferent vkJeo objects VOB-k and VOB-m are alternately 
arrayed within a single interleaved block. By interleaving 
the interleaved units ILVU of two vkieo objects VOB in 
this sequence, it is possible to achieve seamless repro- 
duction branching from one scene to one of plural 
scenes, and from one of plural scenes to one scene. 

Multi-scene control 

The multi-scene period is described together with 
the concept of multi-scene control according to the 
present invention using by way of example a title com- 
prising scenes recorded from different angles. 

Each scene in multi-scene control is recorded from 
the same angle. Ixjt may be recorded at different times 
or may even be computer graphics data. The multi- 
angle scene periods may therefore also be called multi- 
scene periods. 

Parental control 

The concept of recording plural titles comprising 
alternative scenes for such functions as parental lock 
control and recording director's cuts is described below 
using Fig. 15. 

An example of a multi-rated title stream providing 
for parental lock control is shown in Fig. 15. When so- 
called "adult scenes" containing sex. violence, or other 
scenes deemed unsuitable for children are contained in 
a title implementing parental lock control, the title 
stream is recorded with a combination of common sys- 
tem streams SSa, SSb, and Sse, an adult-oriented sys- 
tem stream SSc containing the adult scenes, and a 
child-oriented system stream SSd containing only the 
scenes suitable for children. Title streams such as this 
are recorded as a multi-scene system sj^eam contain- 



ing the adult-oriented system stream Ssc and the child- 
oriented system stream Ssd arrayed to the multi-scene 
period between common system streams Ssb and Sse. 
The relationship between each of the component 
5 titles and the system stream recorded to the program 
chain PGC of a title stream thus comprised is described 
below. 

The adult-oriented title program chain PGC1 com- 
prises in sequence the common system streams Ssa 

10 and Ssb. the adult-oriented system stream Ssc. and the 
common system stream Sse. The child-oriented title 
program chain PGC2 comprises in sequence the com- 
mon system streams Ssa and Ssb, the child-oriented 
system stream Ssd. and the common system stream 

IS Sse. 

By thus arraying the adult-oriented system stream 
Ssc and child-oriented system stream Ssd to a multi- 
scene period, the decoding method previously 
described can reproduce the title containing adult-ori- 

20 ented content by reproducing the common system 
streams Ssa and Ssb, then selecting and reproducing 
the adult-oriented system stream Ssc, and then repro- 
ducing the common system stream Sse as instructed by 
the adult-oriented title program chain PQC1. By alter na- 

25 tively following the child-oriented title program chain 
PGC2 and selecting the child-oriented system stream 
Ssd in the multi-scene period, a child-oriented title from 
which the adult-oriented scenes have been expurgated 
can be reproduced. 

30 This method of providing in the title stream a multi- 
scene period containing plural alternative scenes, 
selecting which of the scenes in the multi-Scene period 
are to be reproduced before playback begins, and gen- 
erating plural titles containing essentially the same title 

35 content but different scenes Iri part, is called parental 
lock control. 

Note that parental lock control is so named 
because of the perceived need to protect children from 
undesirable content. From the perspective of system 

40 stream processing, fiowever, parental lock control is a 
technology for statically generating different title 
streams by means of the user pre-selecting specific 
scenes from a multi-scene period. Note, further, that 
this contrasts with multi-angle scene control, which is a 

45 technology for dynamically changing the content of a 
single title by means of the user selecting scenes from 
the multi-scene period freely and in real-time during title 
playback. 

Tliis parental lock control technology can also be 
so used to enable title stream editing such as when making 
the director's cut. The director's cut refers to the process 
of editing certain scenes from a movie to, for example, 
shorten the total presentation time. This may be neces- 
sary, for example, to edit a feature-length movie for 
55 viewing on an airplane where the presentation time is 
too long for viewing within the flight time or certain con- 
tent may not be acceptable. The movie director thus 
determines which scenes may be cut to shorten the 



24 



47 



EP 0 847 195 A1 



48 



movie. The title can then be recorded with both a full- 
length, unedited system stream and an edited system 
stream in which the edited scenes are recorded to multi- 
scene periods. At the transition from one system stream 
to another system stream in such applications, parental 
lock control must be able to maintain smooth playback 
image output. More specifically, seamless data repro- 
duction whereby a data underflow state does not occur 
in the audio, video, or other buffers, and seamless infor- 
mation reproduction whereby no unnatural interruptions 
are audibly or visibly perceived in the audio and video 
playtsack. are necessary. 

Multi-angle control 

The concept of multi-angle scene control in the 
present invention is described next with reference to 
Fig. 33. In general, multimedia titles are obtained by 
recording both the audio and video information (collec- 
tively "recording" below) of the subject over time T The 
angled scene blocks #SC1, #SM1. #SM2. #SM3. and 
#SC3 represent the multimecfia scenes obtained at 
recording unit times T1, T2. and T3 by recording the 
subject at respective camera angles. Scenes #SM1 . 
#SM2. and #SM3 are recorded at mutually different 
(first, second, and third) camera angles during record- 
ing unit time T2. and are referenced below as the first 
second, and third angled scenes. 

Note that the multi-scene periods referenced herein 
are iDasically assumed to comprise scenes recorded 
from different angles. The scenes may, however, be 
recorded from the same angle but at different times, or 
they may be computer graphics data. The multi-angle 
scene periods are thus the multi-scene periods from 
which plural scenes can be selected for presentation in 
the same time period, whether or not the scenes are 
actually recorded at different camera angles. 

Scenes #SC1 and #SC3 are scenes recorded at 
the same common camera angle during recording unit 
times T1 and T3. i.e., before and after the multi-angle 
scenes. These scenes are therefore called "commori 
angle scenes." Note that one of the multiple camera 
angles used In ttie multi-angle scenes is usually the 
same as the comnxin camera angle. 

To understand the relationship between these vari- 
ous angled scenes, multi-angle scene control is 
described below using a live broadcast of a baseball 
game for example only. 

The common angle scenes #SC1 and #SC3 are 
recorded at tfie common camera angle, which is here, 
defined as the view from center field on the axis through . 
^e pitcher, batter, and catcher. 

The first angled scene #SM1 is recorded at the first 
multi-camera angle, i.e., the camera angle from the 
backstop on the axis through the catcher, pitcher, and 
batter. The second angled scene #SM2 is recorded at 
the second multi-camera angle, i.e., the view from , 
center field on the axis through the pitcher, batter, and 



catcher. Note that the second angled scene #SM2 is 
thus the same as the common camera angle in this 
example. It therefore follows that the second angled 
scene #SM2 is the same as the common angle scene 
5 #SC2 recorded during recording unit time T2. The third 
angled scene #SM3 is recorded at the third multi-cam^ 
era angle. i.e., the camera angle from the backstop 
focusing on tiie infield. 

The presentation times of the multiple angle scenes 
10. #SM1. #SM2. and #SM3 overlap in recording unit time 
T2; this period is called the "nuilti-angle scene period." 
By freely selecting one of the multiple angle scenes 
#SM1. #SM2, and #SM3 in this multi-angle scene 
period, the viewer is able to change his or her virtual 
IS viewing position to enjoy a different view of the game as 
though the actual camera angle is changed. Note tiiat 
while there appears to be a time gap between common 
angle scenes #SC1 and #SC3 and the multiple angle 
scenes #SM1 . #SM2. and #SM3 in Fig. 33. this is simply 
20 to facilitate the use of arrows in the figure for easier 
description of the data reproduction patiis reproduced 
by selecting different smgled scenes. There is no actual 
time gap during playtaack. 

Multi-angle scene control of the system stream 
25 based on the present invention is described next with - 
refererx:e to Fig. 23 from the perspective of connecting 
data blocks. The multimedia data corresponding to 
common angle scene #SC is referenced as common 
angle data BA. and the common angle data BA in 
30 recording unit times T1 and T3 are referenced as BA1 
and BA3. respectively. The multimedia data corre- 
sponding to tiie 'multiple angle scenes #SM1. #SM2. 
and #SM3 are referenced as first, second, and third 
angle scene data MAI. MA2. and MA3. As previously 
35 described with reference to Rg. 33, scenes from the 
desired, angled can be viewed by selecting one of tiie 
multiple angle data units MAI . MA2. and: MAS. There is 
also no time gap between the common angle data BA1 
and BA3 and the multiple angle data units MAI, MA2, 
40 and MA3. 

In the* case of an MPECa system stream, however, 
intermittent breiaks in the playt>ack information can 
result between the reproduced common and multiple 
angle data units depending upon the content of the data 
45 at the connection between the selected multiple £Wigle 
data unit MAI. MA2. and MA3 and the common angle 
data BA (eidier the first common angle data BA1 before 
the angle selected in the multi-angle scene period or the 
common angle data BA3 following tiie angle selected in . 
50 tfie multi-angle scene period). The result in tiiis case is 
that the titie stream is not naturally- reproduced as a sin- 
gle contiguous title, i.e., seamless data reproduction is 
achieved txjt non-seamless information reproduction 
results, 

55 The multi-angle selection process whereby one of 
plural scenes is selectively reproduced from the multi- 
angle scene period with seamless information presenta- 
tion to the scenes before and after is described below 
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with application in a digital video disk system using Fig. 
23, 

Changing the scene angle, i.e., selecting one of the 
multiple angle data units MAI , MA2. and MA3, must be 
completed before reproduction of the preceding com- 
mon angle data BA1 is completed. It Is extremely diffi- 
cult, for example, to change to a different angle data unit 
MA2 during reproduction of common angle data BA1. 
This is because the multimedia data has a variable 
length coded MPEG data structure, which makes it diffi- 
cult to find the data break points (boundaries) In the 
selected data blocks. The video may also be disrupted 
when the angle is changed because inter-frame correla- 
tions are used in the coding process. The 
group_of_pictures GOP processing unit of the MPEG 
standard contains at least one refresh frame, and 
closed processing not referencing frames belonging to 
another GOP is possible within this GOP processing 
unit. 

In other words, if the desired angle data. e. g., MAS. 
is selected before reproduction reaches the multi-angle 
scene period, and at the latest by the time reproduction 
of the preceding common angle data BA1 is completed, 
the angle data selected from within the multi-angle 
scene period can be seamlessly reproduced. However, 
it is extremely difficult while reproducing one angle to 
s^ect and seamlessly r^roduce another angle within 
the same multi-angle scene period. It is therefore diffi- 
cult when in a multi-angle scene period to dynamically 
select a different angle unit presenting, for example, a 
view from a different camera angle. 

Ftow chart! tmmef^r 

The encoding information table generated by the 
encoding system controller 200 from information 
extracted from the scenarfo data St7 is described below 
referring to Rg. 27. 

The encoding information table contains VOB set 
data streams containing plural VOB corresponding to 
the scene periods beginning and ending at the scene 
branching and connecting points, and VOB data 
streams corresponding to each scene. These VOB set 
data streams shown In Fig. 27 are the encoding infor- 
mation tables generated at step #100 in Fig. 34 by the 
encoding system controller 200 for creating the DVD 
multimedia stream based on the user-defined title con- 
tent. 

The user-defined scenario contains branching 
points from common scenes to plural scenes, or con- 
nection points to other common scenes. The VOB cor- 
responding to the scene period delimited by these 
branching and connecting points is a VOB set. and the 
data generated to encode a VOB set is the VOB set 
data stream. The title number specified by the VOB set i 
data stream is the title number TITLE_NO of the VOB 
set data stream. 

The VOB Set data structure in Fig. 27 shows the 



data content for encoding one VOB set in the VOB set 
data stream, and comprises: the VOB set number 
VOBS_NO. the VOB number VOB_NO in the VOB set. 
the preceding VOB seamless connection flag VOB_Fsb, 
5 the following VOB seamless connection flag VOB_Fsf. 
the multi-scene flag VOB_Fp, the interleave flag 
VOB_Fi, the multi-angle flag VOB_Fm, the multi-angle 
seamless switching flag VOB_FsV, the maximum bit 
rate of the interleaved VOB ILV_BR. the number of inter- 
10 leaved VOB divisions ILV_DIV. and the minimum inter- 
leaved unit presentation time ILVU_MT. 

The VOB set number VOBS_NO is a sequential 
number identifying the VOB set and the position of the 
VOB set in the reproduction sequence of the title sce- 
15 nario. 

The VOB number VOB_NO is a sequential number 
identifying the VOB and the position of the VOB in the 
reproduction sequence of the title scenario. 

The preceding VOB seamless connection flag 
20 VOB_Fsb indicates whether a seamless connection 
with the preceding VOB is required for scenario repro- 
duction. 

The following VOB seamless connection flag 
VOB_Fsf indicates whether there is a seamless con- 
25 nection with the following VOB during scenario repro- 
duction. 

The multi-scene flag VOB_Fp identifies whether the 
VOB set comprises plural video objects VOB. 

The interleave flag VOB_Fi identifies whether the 
30 VOB in the VOB set are interieaved. 

The multi-angle flag VOB_Fm identifies whether the 
VOB set is a multi-angle set. 

The multi-angle seamless switching flag VOB_FsV 
identifies whether angle changes within the multi-angle 
35 scene period are seamless or not. 

The maximum bit rate of the interleaved VOB 
1LV_BR defines the maximum bit rate of the interieaved 
VOBs. 

The number of interleaved VOB divisions ILV_DIV 
40 identifies the number of interleave units in the inter- 
leaved VOB. 

The minimum interieave unit presentation time 
ILVU_MT defines the time that can be reproduced when 
the bit rate of the smallest interleave unit at which a 
45 track buffer data underflow state does not occur is the 
maximum bit rate of the interieaved VOB ILV^BR during 
interieaved block reproduction. 

The encoding information table for each VOB gen- 
erated by the encoding system controller 200 based on 
so the scenario data St7 is described below referring to 
Fig. 28. The VOB encoding parameters described 
below and supplied to the video encoder 300. audio 
encoder 700, and system encoder 900 for stream 
encoding are produced based on this encoding informa- 
55 tion table. 

The VOB data streams shown in Fig. 28 are the 
encoding information tables generated at step #100 in 
Fig. 34 by the encoding system controller 200 for creat- 



26 



51 



EP 0 847 195 A1 



52 



ing the DVD multimedia stream based on the user- 
defined title content 

The encoding unit is the video object VOB, and the 
data generated to encode each video object VOB is the 
VOB data stream. For example, a VOB set comprising s 
three angle scenes cornprises three video objects VOB. 
The data structure shown in Fig. 28 shows the content 
of the data for encoding one VOB in the VOB data 
stream. 

The VOB data structure contains the video material io 
start time VOB_VST. the video material end time 
VOB_VEND, the video signal type VdB_V_KIND. the 
video encoding bit rate V_BR. the audio material start 
time VOB_AST. the audio material end time 
VOB_AEND, the audio coding method VOB_A_KIND. is 
and the audio encoding bit rate A_BR. 

The video material start time VOB_VST Is the video 
encoding start time corresponding to the time of the 
video signal. 

The video material end time VOB_VEND is the 20 
video encoding end time corresponding to the time of 
the vidieo signal. 

The video material type VOB__V_KIND identifies 
whether the encoded material is in tiiei NTSC or PAL for- 
mat, for example, or is photographic material (a movie. 25 
for example) converted to a television broadcast format 
(so-called teledne conversion). 

The video encoding bit rate V_BR Is the bit rate at 
which tiie video signal is encoded. 

The audio material start time VOB_AST is the 30 
audio encoding start time corresponding to the time of 
the audio signal. 

The audio material end time VOB_AEND is the 
audio encoding end time corresponding to the time of 
the audio signal. 35 

The audio coding method VOB_A_KIND identifies 
the audio encoding method as AC-3, MPEG, or linear 
PCM, for example. 

The audio encoding bit rate A_BR Is tfie l>it rate at 
which the audio signal is encoded. 40 

The encoding parameters used by ^ the video 
encoder 300, sub-picture encoder 500, and audio . 
encoder 700, and system encoder 900 for VOB encod- 
ing are shown in Fig. 29. The encoding parameters 
include: the VOB number VOB_NO. video encode start 45 
time V_STTM, video encode end time V_ENDTM, the 
video encode mode V.ENCMD. the video encode bit 
rate V_RATE, the maximum video encode bit rate 
V_MRATE. tiie GOP structure fixing flag GOP^Fxflag. 
tiie video encode GOP structure GOPST, the initial so 
video encode data VJNTST, the last video encode data 
V_ENDST. the audio encode start time A_STTM, the 
audio encode end time A_ENDTM. the audio encode bit 
rate A_RATE, tiie audio encode method A_ENGMD. tfie 
audio start gap. A_STGAP. the audio en6 gap ss 
A.ENDGAP, tiie preceding VOB number B_VOB_NO. 
and the following VOB number F_VOB_NO. 

The VOB nun^er VOB_NO is a. sequential number 




identifying the VOB and the position of the VOB in the 
reproduction sequence of the titie scenario. 

The video encode start time V^STTM is the start 
time of video material encoding. 

The video encode end time V_ENDTM is the end 
time of video material encoding. 

The video encode mode V_ENGMD is an encoding 
mode for declaring whether reverse telecine conversion 
shall be accomplished during video encoding to enable 
efficient coding when the video material is telecine con^ 
verted material. 

The video encode bit rate V_RATE is the average 
bit rate of video encoding. 

The maximum video encode bit rate V_MRATE is 
the maximum bit rate of video encoding. 

The GOP structure fixing flag GOP_Fxflag speci- 
fies whether encoding is accomplished witiiout chang- 
ing the GOP structure in the middle of the video 
encoding process. This is a useful parameter for declar- 
ing whether seamless switch is enabled in a multi-angle 
scene period. 

The video encode GOP structure GOPST Is tiie 
GOP structure data from encoding. 

The initial video encode data V_INTST sets the ini- 
tial value of tiie VBV buffer (decoder buffer) at the start . 
of video encoding, €uid is referenced during video 
decoding to initialize the decoding buffer. This is a use- 
ful parameter for declaring seamless reproduction with 
the preceding encoded video stream. 

The last video encode data V_ENDST sets the end 
value of the VBV buffer (decoder tHjffer) at tiie end of 
video encoding, and is referenced during video decod- 
ing to initialize the decoding buffer. This is a useful 
parameter for declaring seamless reproduction with the 
preceding encoded video stream. . 

The aiudio encode start time A_STTM is the start 
time of audio material encoding. 

The audio encode end time A_ENDTM is the end 
time of audio material encoding. 

The audio encode bit rate A_RATE is the bit rate 
used for audio encoding . 

The audio encode method A_ENCMD Identifies the 
audio encoding method as AC-3. MPEG, or linear PCM. 
for example. 

The audio start gap A_STGAP is the time offset 
between the start of the audio and video presentation at . 
the beginning of a VOB. This is a useiful pararheter for 
declaring seamless reproduction with tiie preceding 
encoded system stream. 

The audio end gap A^ENDGAP'. is the time offset ^ 
between the end of the audio and video presentation at 
the end of a VOB. This Is a useful parameter for declar- 
ing seamless reproduction with the preceding encoded 
system stream. 

The preceding VOB number B_VOB_NO Is the 
VOB_Np of the preceding VOB when there fe a seam- 
lessly connected preceding VOB. 

The following VOB number F_VOB_[sio is the 
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VOB_NO of the following VOB when there is a seam- 
lessly connected following VOB. 

The operation of a DVD encoder BCD according to 
the present invention is described below with reference 
to the flow chart in Rg, 34. Note that the steps shown 
with a double line are subroutines. It should be obvious 
that while the operation described below relates specif- 
ically In this case to the DVD encoder ECD of the 
present invention, the operation described also applies 
to an authoring encoder EC. 

At step #100, the user Inputs the ecfiting commands 
according to the user-defined scenario while confirming 
the content of the multimedia source data streams St1 , 
St2. and StS. 

At step #200. the scenario editor 100 generates the 
scenario data St7 containing the above edit command 
information accorcfing to the user's editing instructions. 

When generating the scenario data St7 in step 
#200. the user editing commands related to multi-angle 
and parental lock multi-scene periods in which inter- 
leaving is presumed must be input to satisfy the follow- 
ing conditions. 

Rrst the VOB maximum bit rate must be set to 
assure sufficient image quality, and the track buffer 
capadty, jump performance, jump time, and jump dis- 
tance of the DVD decoder DCD used as the reproduc- 
tion apparatus of the DVD encoded data must be 
determined. Based on these values, the reproduction 
time of the shortest interieaved unit is obtained from 
equations 3 and 4. Based on the reproduction time of 
each scene in the multi-scene period, it must then be 
determined whether equations 5 and 6 are satisfied. H 
equations 5 and 6 are not satisfied, the user must 
change the edit commands until equations 5 and 6 are 
satisfied by. for example, connecting part of the follow- 
ing scene to each scene in the multi-scene period. 

When multi-angle edit commands are used, equa- 
tion 7 must be satisfied for seamless switching, and edit 
commands matching the audio reproduction time with 
the reproduction time of each scene in each angle must 
be entered. If non-seamless switching is used, the user 
must enter commands to satisfy equation 8. 

At step #300, the encoding system controller 200 
first determines whether the target scene is to be seam- 
lessly connected to the preceding scene based on the 
scenario data St7. 

Note that when the preceding scene period is a 
multi-scene period conprising plural scenes but the 
presently selected target scene is a common scene (not 
in a multi-scene period), a seamless connectfon refers 
to seamlessly connecting the target scene with any one 
of the scenes contained In the preceding multi-scene 
period. When the target scene is a multi-scene period, a 
seamless connection still refers to seamlessly connect- 
ing the target scene with any one of the scenes from the 
same multi-scene period. 

If step #300 returns NO, i.e.. a non-seamless con- 
nection is valid, the procedure moves to step #400. 



At step #400, the encoding system controller 200 
resets the preceding VOB seamless connection flag 
VOB_Fsb indicating whether there is a seamless con- 
nection between the target and preceding scenes. The 
5 procedure then moves to step #600. 

On the other hand, if step #300 returns YES. i.e.. 
there is a seamless connection to the preceding scene, 
the procedure moves to step #500. 

At step #500 the encoding system controller 200 
10 sets the preceding VOB seamless connection flag 
VOB_Fsb. The procedure then moves to step #600. ^ 

At step #600 the encoding system controller 200 
determines whether there is a seamless connection 
between the target and following scenes based on see- 
rs nario data St7. If step #600 returns NO. i.e.. a non- 
seamless connection is vafid, the procedure moves, to 
step #700. 

At step #700. the encoding system controller 200 
resets the following VOB seamless connection flag 
20 VOB_Fsf indicating whether there is a seamless con- 
nection with the following scene. The procedure then 
moves to step #900, 

However, if step #600 returns YES, i.e., there is a 
seamless connection to the following scene, the proce- 
ss dure moves to step #800. 

At step #800 the encoding system controller 200 
sets the following VOB seamless connection flag 
VOB__Fsf. The procedure then moves to step #900. 
At step #900 the encoding system controller 200 
30 determines whether there is more than connection tar- 
get scene, i.e., whether a multi-scene period is 
selected, based on the scenario data St7. As previously 
described, there are two possible control methods in 
multi-scene periods: parental lock control whereby only 
35 one of plural possible reproduction paths that can be 
constructed from the scenes in the multi-scene period is 
reproduced, and multi-angle control whereby the repro- 
duction path can be switched within the multi-scene 
period to present different viewing angles. 
40 n step #900 returns NO. i.e., there are not multiple 
scenes, the procedure moves to step #1 000. 

At step #1000 the multi-scene flag VOB_Fp identi- 
fying whether the VOB set comprises plural video 
Objects VOB (a multj-scene period is selected) is reset. 
45 and the procedure moves to step #1800 for encode 
parameter production. This encode parameter produc- 
tion subroutine is described below. 

However, if step #900 returns YES, there is a multi- 
scene connection, the procedure moves to step #1 100. 
50 At step #1 100. the multi-scene flag VOB_Fp is set, 
and the procedure moves to step #1200 whereat it is 
judged whether a multi-angle connection is selected, or 
not. 

At step #1 200 it is determined whether a change is 
55 made between plural scenes in the multi-scene period, 
i.e., whether a riiulti-angle scene period is selected. If 
step #1200 returns NO. i.e.. no scene change is allowed 
in the multi-scene period as parental lock control repro- 
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ducing only one reproduction path has been selected, 
the procedure moves to step #1 300. 

At step #1300 the multi-angle flag VOB_Fm identi- 
fying whether the target connection scene is a multi- 
angle scene is reset, and the procedure moves to step s 
#1302. 

At step #1302 H is determined whether either the 
preceding VOB seamless connection flag VOB_Fsb or 
following VOB seamless connection flag VOB_Fsf is 
set If step #1302 returns YES, i.e.. the target connec- io 
Hon scene seamlessly connects to the preceding, the 
following, or both the preceding and following scenes, 
the procedure moves to step #1304. 

At step #1 304 the interleave flag VOB_Fi identifying 
whether the VOB. the encoded data of the target scene, is 
is interleaved is set The procedure then moves to step 
#1800. 

However, if step #1302 returns NO. i.e.. the target 
connection scene does not seamlessly, connect to the 
preceding or following scene, the procedure moves to 20 
step #1306. 

At step #1306 the interleave flag VOB_Fi is reset 
and the procedure moves to step #1 800. 

If step #1200 returns YES. however, i. e.. there is a 
multi-angle connection, the procedure moves to step 25 
#1400. 

At step #1400, the multi-angle flag VOB_Fm and 
interleave flag VOB_Fi are set, and the procedure 
moves to step #1 500. 

At step #1500 the encoding system controller 200 30 
determines whether the audio and video can be seam- 
lessly; switched in a multi-angle scene period. i:e.. at a 
reproduction unit smaller than the VOB, based on the 
scenario data St7. If step #1500 returns NO, i.e.. non- 
seamless switching occurs, the procedure moves to 3s 
step #1600. 

At step #1600 the multi-angle seamless switching 
flag VOB_FsV indicating whether angle changes within 
the multi-angle scene period are seamless or not is 
reset, and the procedure moves to step #1800. 40 

However, if step #1500 returns YES, i.e., seamless 
switching occurs, the procedure moves to step #1 700. 

At step #1700 the multi-angle seamless switching 
flag VOB_FsV is set, and the procedure moves to step 
#1800. 45 

Therefore, as shown, by the flow chart in Rg. 34. 
encode parameter production (step #1800) is only 
begun after the editinjg information is detected from the 
above flag settings; in the scenario data St7 reflecting 
the user-defined editing instructions. - so 

Based on the user-defined editing instructions 
detected from the at)ove f lag settings in the scenario 
data St7. information is added to the encoding informal 
tion tables for the VOB Set units and VOB units as 
shown in Rgs. 27 and 28 to encode the source streams, ss 
and the encoding parameters of tfie VOB data units 
shown in Fig. 29 are produced, in step #1800. The pro- 
cedure then nfK3ves to step #1900 for audio and video 



encoding. 

The encode parameter production steps (step 
#1 800) are described in greater detail below refeiring to 
Figs. 35. 36. 37 and 38. 

Based on the encode parameters produced in step 
#1800, the video data and audio data, are encoded in 
step #1900. and the procedure moves to step #2000. 

Note that the sub^picture data is normally inserted 
during video reprdduction on an as-needed basis, and 
contiguity with the preceding and following scenes is 
therefore not usually necessary. Moreover, the sub-pic- 
ture data is normally video information for one frame, 
and unlike audio and video data having an extended 
time-base, sub-picture data is usually static, and is not 
normally presented continuously. Because the present 
invention relates specifically to. seamless and non- 
seamless contiguous reproduction as described above., 
description of sub-picture data encoding is omitted 
herein for sirhplicity. 

Step #2000 is the last step in a loop comprising 
steps #300 to step ^000. and causes this loop to be 
repeated as many times as there are VOB Sets. This 
loop formats the program chain VTS_PGG#i to contain 
the reproduction sequence and other reproduction infor- 
mation for each VOB in the title (Rg. 16) in the program 
chain data structure, interieaves the VOB in the muHi- 
^ scene periods, and completes the VOB Set data stream 
and VOB data stream needed for system stream encod- 
ing. The procedure then moves to step #21 00. 

At step #2100 the VOB Set data stream is com- 
pleted as the encoding information table by adding the 
total number of VOB Sets VOBS_NUM obtaihedias a 
result of the loop through step #2000 to the VOB Set 
data stream, and setting the number of tities T1TLE_N0 
defining the number of scenario reproduction paths in 
the scenario data St7. The procedure then nrioves to 
step #2200. 

System stream encoding producing the VOB 
(VOB#i) data in tiie VTS titie VOBS (VTSTT^VOBS) 
(Fig. 16) is accomplished in step #2200 based on the 
encoded video stream and encoded audib stream out- 
put from step #1900, and the encode parameters in Fig. 
29. The procedure then moves to step #2300: 

At step #2300 tine VTS information VTSI. VTSI 
management table VTSLMAT. VTSPGC information 
table VTS_PGGIT, and the program chain intormation ^ 
VTS_PGCI#i controlling the VOB data reproduction 
sequence shown in Rg. 16 are produced, and format- 
ting to. for example, interieave the VOB contained in the 
multi-scene periods, is accomplished. 

the specific steps executed in this foi-matting oper- 
ation are described below with reference to Rgs. 40. 41 , 
42. 43, and 44, 

The encode parameter production . subroutine ; 
shown as stiep #1800 in Fig. 34B is described next using 
Rgs. 35. 36. and 37 using by way of example the oper- 
ation generating the encode parameters for multi-angle 
control. 
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Starting from Fig, 35. the process for generating the 
encode parameters of a non-seamless switching 
stream with multi-angle control is described first. This 
stream is generated when step #1500 in Fig. 34 returns 
NO and the following flags are set as shown: VOB^Fsb 5 
= 1orVOB_Fsf=1.VOB_Fp=1,VOB_Fi=1,VOB Fm 
= 1. and VOB^FsV = 0. The following operation pro- 
duces the encoding information tables shown in Fig. 27 
and Rg. 28, and the encode parameters shown in Fig. 
29. 

10 

At step #1812. the scenario reproduction sequence 
(path) contained in the scenario data St7 is extracted, 
the VOB Set number VOBS^NO is set. and the VOB 
number VOB_NO is set for one or more VOB in the VOB 
Set 

IS 

At step #1814 the maximum bit rate ILV_BR of the 
interleaved VOB is extracted from the scenario data 
St7, and the maximum video encode bit rate V_MRATE 
from the encode parameters is set based on the inter- 
leave flag VOB_Fi setting (= 1 ). 20 

At step #1816. the minimum interieaved unit pres- 
entation time ILVU^MT is extracted from the scenario 
data St7. 

At step #1818, the video encode GOP structure 
GOPST values N = 15 and M = 3 are set and the GOP 2s 
structure fixing flag GOP^Fxflag is set (*r 1), based on 
the multi-scene flag VOB_Fp setting (= 1). 

Step #1820 is tiie common VOB data setting rou- 
tine, which is described below referring to the flow chart 
in Rg. 36. This common VOB data setting routine pro- 30 
duces the encoding information tables shown in Figs. 27 
and 28. and the encode parameters showvn in Rg. 29. 

At step #1822 the video material start time 
VOB_VSTand video material end time VOB_VEND are 
extracted for each VOB, and the video encode start time 35 
V_STTM and video encode end time V_ENDTM are 
used as video encoding parameters. 

At step #1824 tfie audio material start time 
VOB.AST of each VOB is extracted from the scenario 
data St7. and the audio encode start time A^STTM is 4o 
set as an audio encoding parameter. 

At step #1826 the audio material end time 
VOB^AEND is extracted for each VOB from the sce- 
nario data St7. and at a time not exceeding the 
VOB^AEND time. This time extracted at an audio 45 
access unit (AAU) is set as the audio encode end time 
A_ENDTM which is an audio encoding parameter. Note 
that the audio access unit AAU is detemiined by the 
audio encoding metiiod. 

At step #1828 the audio start gap A_STGAP so 
obtained from the difference between the video encode 
start time V^STTM and the audio encode start time 
A_STTM is defined as a system encode parameter. 

At step #1830 the audio end gap A_ENDGAP 
obtained from the difference between the video encode ss 
end time V^ENDTM and the audio encode end time 
A.ENDTM is defined as a system encode parameter. 
At step #1832 tfie video encoding bit rate V_BR is 



extracted from the scenario data St7, and the video 
encode bit rate V_RATE. which is the average bit rate of 
video encoding, is set as a video encoding parameter. 

At step #1834 tile audio encoding bit rate A_BR is 
extracted from the scenario data St7. and the audio 
encode bit rate A_RATE is set as an audio encoding 
parameter. 

At step #1836 the video material type 
VOB_V_KIND is extracted from the scenario data St7. If 
the material is a film type, i.e.. a movie converted to tel- 
evision broadcast format (so-called telecine conver- 
sion), reverse telecine conversion is set for the video 
encode mode V^ENGMD. and defined as a video 
encoding parameter. 

At step #1838 the audio coding method 
VOB_A_KIND is extracted from the scenario data St7, 
and the encoding method is set as the audio encode 
method A_ENGMD and set as an audio encoding 
parameter. 

At step #1840 the initial video encode data 
V_INTST sets ttie initial value of the VBV buffer to a 
value less than the VBV buffer end value set by ttie last 
video encode data V_ENDST, and defined as a video 
encoding parameter. 

At step #1842 the VOB number VOB_NO of the 
preceding connection is set to the preceding VOB 
number B_VOB_NO based on the setting (= 1) of the 
preceding VOB seamless connection flag VOB_Fsb, 
and set as a system encode parameter. 

At step #1 844 the VOB number VOB_NO of the fol- 
lowing connection is set to the following VOB number 
FLVOB_NO based on the setting (=: 1) of the following 
VOB seamless connection flag VOB_Fsf. arxJ set as a 
system encode parameter. 

The encoding information table and encode param- 
eters are thus generated for a multi-angle VOB Set with 
non-seamless multi-angle switching control enabled. 

The process for generating the encode parameters 
of a seamless switching st-eam witii multi-angle control 
is described below with reference to Rg. 37. This 
stream Is generated when step #1500 in Rg. 34 returns 
YES and the following flags are set as shown: VOB_Fsb 
= 1 or VOB^Fsf = 1 . VOB^Fp = 1 , VOB_Fi = 1 , VOB_Fm 
= 1, and VOB_FsV.=: 1. The following operation pro- 
duces the encoding information tables shown in Rg. 27 
and Rg. 28, and the encode parameters shown in Rg. 
29. 

The following operation produces ttie encoding 
information tables shown in Fig. 27 and Fig. 28. and the 
encode parameters shown in Fig. 29. 

At step #1850. tfie scenario reproduction sequence 
(patfi) contained in the scenario data St7 is extracted, 
tfie VOB Set number VOBS_NO is set. and the VOB 
nuriiber VOB_NO is set for one or more VOB in the VOB 
Set 

At step #1852 the maximum bit rate ILV_BR of tfie 
interieaved VOB is extracted from tfie scenario data 
St7, and the maximum video er^code bit rate V_MRATE 
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from the encode parameters is set based on the inter- 
leave flag VOB_FI setting (=1). 

At step #1854, the minimum interleaved unit pres- 
entation time ILVU_MT is extracted from the scenario 
data St7. 

At step #1856, the video encode GOP structure 
GOPST values N = 15 and M = 3 are set and the GOP 
structure fixing flag GOP_Fxflag is set (= 1). based on 
the multi-scene flag VOB_Fp setting (=1). 

At step #1858, the video encode GOP GOPST is 
set to "closed GOP" based on the multi-angle seamless 
switching flag VOB_FsV setting (= 1), and the video 
encoding parameters are thus defined. 

Step #1860 is the common VOB data setting rou- 
tine, which is as described referring to the flow chart in 
Fig. 35. Further description thereof is thus omitted here. 

The encode parameters of a seamless switching 
stream with multi-angle control are thus defined for a 
VOB Set with multi-angle control as described above. 

The process for generating the encode parameters 
for a system stream In which parental lock control Is 
implemented is desaibed below with reference to Fig. 
38. This stream is generated when step #1 200 in Rg. 34 
returns NO and step #1304 returns YES, i.e., the follow- 
ing flags are set as shown: VOB_Fsb = 1 or VOB_Fsf = 
1, VOB_Fp = 1, VOB_Fi = 1, VOB_Fm = 0. The follow- 
ing operation produces the encoding information tables 
shown in Rg. 27 and Fig. 28, and the encode parame- 
ters shown in Fig. 29. 

At step #1870, the scenario reproduction sequence 
(path) contained in the scenario data St7 is extracted, 
the VOB Set number VOBS_NO is set and the VOB 
number VOB_NO is set for one or more VOB in the VOB 
Set. 

At step #1872 the maximum k)it rate ILV_BR of the 
interleaved VOB is extracted from the scenario data 
St7, and the maximum video encode bit rate V_MRATE 
from the encode parameters is set based on the inters 
leave flag VOB_Fi setting (= 1). 

At step #1872 the number of interleaved VOB divi- 
sions ILV.DIV is extracted from the scenario data St7. 

Step #1876 is the common VOB data setting rou- 
tine, which is as described referring to the flow chart in 
Fig. 35. Further description thereof is thus omitted here. 

The encode parameters of a system stream in 
which parental lock control is implemented are thus 
defined for a VOB Set with multi-scene selection control 
enabled as described above. 

The process for generating the encode parameters ' 
for a system stream containing a single scene is 
described below with reference to Fig. 39. This stream 
is generated when step #900 in Fig. 34 returns NO, i.e., 
when VOB_Fp=0. The following operation produces the 
encoding information tatDles shown in Fig.. 27 and Rg. 
28, and the encode parameters shown in Rg. 29. 

At step #1880. the scenario reproduction sequence 
(path) contained. in the scenario data St7 is extracted, 
the VOB Set number VOBS NO is set, and the VOB 



number VOB_NO is set for one or more VOB in the VOB 
Set 

At step #1882 the maximum bit rate ILV_BR of the 
interleaved VOB is extracted from the scenario data 
5 St7. and the maximum video encode bit rate V_MRATE 
from the encode parameters is set based on the inter- 
leave flag VOB_R setting (= 1 ). 

Step #1884 is the common VOB data setting rou- 
tine, which is as described referring to the f tow chart in 
10 Fig. 35. Further description thereof is thus omitted here. 

These flow charts for defining the encoding infor- 
mation table and encode parameters thus generate ti^e 
parameters for DVD video, audio, and system stream 
encoding by the DVD formatter. H 

FPf matter flQvy chart? 

The operation of the subroutine executed by the 
DVD formatter shown as step #2300 in Fig. 34B is 
20 described next with reference to Rgs. 40. 41. 42. 43. 
and 44. This formiatter subroutine generates the DVD 
multimedia bitstream. 

The operation of the DVD encoder ECD 1100 
according to the present invention is described with ref- . 
25 erence to tiie f low chart in Fig. 40. Note that those st^ 
shown in Rg.\40 With a double line are subroutines. 

At step #2310 the program chain inforhriation 
VTS_PGGI is set to the VTSI management table 
VTSLMAT for the number of tities TITLE_NUM based 
30 on the number of titles TITLE.NUM in tiie yOB Set data 
stream. 

At step #2312 it is determined whether multi-scene 
selection control is enabled based on the multi-scene 
flag VOB_Fp in ttie VOB Set data stream. If step #231 2 
35 returns NO. i.e.. multi-scene control Is not enabled, the 
procedure moves to step #21 14. 

At step #2314 the operation for coding a single 
scene (VOB) executed by the formatter 1100 of the 
authoring encoder EC shown in Fig. 25 is accom- 
40 plished. This routine is described later. 

If step #2312 returns YES. i.e., multi-scene control 
is enat>led, the procedure moves to step #2116. 

At step #2316 it is determined whether the informa- 
^ tion is to be interleaved or not based on the interleave 
45 flag VOB.R state in the VOB Set data stream. If step 
^ ' #2316 returns NO. i.e., the information is not to be inter- 
leaved, the pi'ocedure moves to step #2314. If step 
#2316 returns YES. i.e., the information is to be-inter- 
leaved, the procedure moves to step #2318. 
50- ' At step #2318 it is determined whether multi-angle 
' control is to be implemented based on the multi-angle 
flag VbB_Fm in the VOB Set data stream. If step #231 8 
returns NO, the parental lock control routine in step 
#2320 is executed. If step #2318 retums YES. the pro- 
55 cediire moves to step #2322. 

At step #2320 the operation for formatting the VOB 
Set for parental lock control is executed. This subroutine 
is shown in Rg. 43 and described below. 
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At step #2322 it is determined whether multi-angle 
seamless switching is required t)ased on the multi-angle 
seamless switching flag VOB.FsV. If multi-angle switch- 
ing is accomplished without seamless switching, i.e.. 
with non-seamless switching and step #2322 returns 
NO. the procedure moves to step #2326. 

The multi-angle non-seamless switching control 
routine executed In step #2326 by the formatter 11 00 of 
the authoring encoder EC in Fig. 25 is described later 
with reference to Fig. 41. 

If multi-angle switching is accomplished with seam- 
less switching control. i.e.. step #2322 returns YES, the 
procedure moves to step #2324. 

The multi-angle seamless switching control routine 
executed in step #2324 by the formatter 1100 of the 
authoring encoder EC in Rg. 25 is described later with 
reference to Fig. 42. 

The cell playback information (PCG information 
entries C_PBI) of the VTS information VTSI set as pre- 
viously described is then recorded. 

At step #2330 it is determined whether all VOB Sets 
declared by the VOB Set number VOBS_NUM have 
been processed by the formatter. If NO. control loops 
back to step #2312. and the process runs again. If YES, 
all sets have been formatted, the procedure terminates. 

Referring to Fig. 41, the multi-angle non-seamless 
switching control routine executed in step #2326 when 
step 4t2322, Fig, 40, returns NO is described. This rou- 
tine defines the interleaved arrangement of the multime- 
dia bitstream MBS. the content of the cell playback 
information {C_PBI#i) shown in Fig. 16. and the infor- 
mation stored to the navigation pack NV shown in Fig. 
20, in the generated DVD multimedia bitstream MBS. 

At step #2340 based on the multi-angle flag 
VOB_Fm setting (= 1) declaring whether multi-angle 
control is applied in the multi-scene period, the cell 
block mode CBM (Fig. 16) of the cell playback informa- 
tion blocks C_PBI ^#i containing the VOB control infor- 
matfon for each scene is declared according to the 
position of the angle data. For example, the cell block 
mode CBM of the MAI cell (Fig. 23) is declared as 01b 
to indicate the beginning of the cell block, the CBM of 
MA2 is declared as 10b to indicate a cell between the 
first and last cells in the block, and the CBM of MA3 is 
declared as 1 1 b to indicate the end of the cell block. 

At step #2342 based on the multi-angle flag 
VOB_Fm setting (= 1) declaring whether multi-angle 
control is applied in the multi-scene period, the cell 
block type CBT (Fig. 1 6) of the cell playback information 
blocks C_PBI #i containing the VOB control information 
for each scene is declared as 01b to indicate an "angle." 

At step #2344 the seamless playbackf lag SPF (Fig. 
16) is set to 1 in the cell playback information blocks 
C_PBI #i containing the VOB control information for 
each scene based on the preceding VOB seamless 
connection flag VOB_Fsb state, which is set to 1 to indi- 
cate a seamless connection. 

At step #2346 the STC resetting flag STCDF is set 




to 1 in the cell playback information blocks C_PBI #i 
containing the VOB control information for each scene 
based on the preceding VOB seamless connection flag 
VOB_Fsb state, which is set to 1 to indicate a seamless 
5 connection. 

At step #2348 the interleaved allocation flag lAF 
(Fig. 16) is set to 1 in the cell playl^ack information 
blocks C_PBI #i containing the VOB control information 
for each scene based on the multi-angle seamless 
10 switching flag VOB_FsV state, which is set to 1 to indi- 
cate interleaving is required. 

At step #2350 the location of the navigation pack 
NV (relative sector number from the VOB beginning) is 
detected from the title editing unit (VOB below) obtained 
IS from the system encoder 900 in Fig. 25. the navigation 
pack NV is detected based on the minimum interieaved 
unit presentation time ILVU_MT information (a formatter 
parameter obtained in step #1816. Fig. 34). the location 
of the VOBU expressed as the number of sectors from 
20 tfie VOB beginning, for exanple, is thus obtained, and 
the title editing unit VOB is dtvkled Into interieave units 
using VOBU units. 

For example, if in this example the minimum inter- 
leaved unit presentation time ILVU_MT is 2 sec and the 
2s presentation time of one VOBU is 0.5 sec., then tiie 
VOB is divided into interieave units of 4 VOBU each. 
Note that tiiis allocation operation is applied to the VOB 
constituting each multi-scene data unit. 

At step #2352 the interleave units of each VOB 
30 obtained from step #2350 are arranged in tiie cell block 
mode CBM sequence (cell block beginning, middle, and 
end cells) written as the VOB control information for 
each scene in step #2340 to form the interleaved blocks 
as shown in Fig. 57 or 58. The interieaved blocks are 
35 then added to the VTS title VOBS (VTSTT_VOBS). 
Using the cell block mode CBM declarations above, for 
example, the angle data MAI. MA2, and MA3 (Rg. 23) 
are arranged in tiiat sequence. 

At step #2354 the relative sector number from the 
40 VOBU start is written to the VOB end pack address 
VOBU_EA (Rg. 20) in the navigation pack NV of each 
VOBU based on the VOBU position information 
otDtained in step #2350. 

At step #2356 the first cell VOBU start address 
45 CJFVOBUJBA and the last cell VOBU start address 
C_LVOBU_SA expressed as the number of sectors 
from the beginning of the VTS titie VOBS 
(VTSTT_VOBS) are written as the addresses of the 
navigation packs NV of the first and last VOBU In each 
so cell based on the VTS titie VOBS (VTSTT_VOBS) data 
obtained in step #2352. 

The angle #i VOBU start address 
NSML_AGL_C1_DSTA - NSML.AGL_C9_DSTA of tfie 
non-seamless angle information NSML_AGLI (Rg. 20) 
ss in tiie navigation pack NV of each VOBU is written at 
step #2358. This address is expressed as the relative 
sector number inside the data of the interieaved blocks 
formed in step ^6352, and declares tiie address infor- 



32 



63 



EP 0 847 195 A1 



64 



mation (Fig. 20) of the navigation pack NV contained in 
the VOBU of all angle scenes near the presentation 
start time of the VOBU being processed. 

At step #2360 "TFFFFFFFh" is written to the angle 
#i VOBU start address NSML_AGL_C1_DSTA - 
NSML_AGL_C9_DSTA of the nonrseamless angle 
Information NSML_AGLI (Fig. 20) in the navigation pack 
NV of each VOBU if the VOBU being processed is the 
last VOBU of each scene in the multi-scene period. 

This routine thus formats the interleaved blocks for 
multi-angle non-seamless switching control in the multi- 
scene period, and formats the cell control information as 
the reproduction control information for those multiple 
scenes. 

Referring to Fig. 42, the multi-angle seamless 
switching control routine executed in step #2324 when 
step «322. Rg. 40. returns YES Is described. This rou- 
tine defines the interleaved arrangement of the multime- 
dia bitstream MBS. the content of the cell playback 
information (C_PBI#i) shown in. Rg. 16. and the infor- 
mation stored to the navigation pack NV shown in Fig. 
. 20. in the generated OVD multimedia bitstream MBS. 
At step #2370 based on the multi-angle flag 
VOB_Fm setting (= 1) declaring whether multi-angle 
control is applied in the multi-scene period, the cell 
block mode CBM (Fig. 16) of the cell playback infornia-^ 
tion blocks C_PBI #i containing the VOB control infor- 
mation for each scene is declared according to the 
position of the angle data. For example, the cell block 
mode CBM of the MA1 cell (Fig, 23) is declared as 01b 
to indicate the beginning of the cell block, the CBM of 
MA2 is declared as 10b to indicate a cell between tiie 
first and last cells in the block, and the CBM of MA3 is 
declared as 1 1 b to indicate the end of the cell block. 

At step #2372 based on the multi-angle flag 
VOB_Fm setting (= 1) declaring whether multi-angle 
control is applied in the multi-scene period, the cell 
block type CBT (Rg. 1 6) of the cell playback information 
blocks C_PBI #i containing tfie VOB conti-ol information 
for each scene is declared as 01b to indicate an "angle." 

At step #2374 the seamless playback flag SPF (Rg. 
16) is set to 1 in the cell playback information blocks 
C_PBI #i containing the VOB control information for 
each scene based on the preceding VOB seamless 
connection flag VOB_Fsb state, which is set to 1 to indi- 
cate a seamless connection. 

At step #2376 the STC resetting flag STCDF is set 
to 1 in the cell playback information blocks C_PBI #i 
containing the VOB control information for each scene 
based on the preceding VOB seamless connection flag 
VOB_Fsb state, which is set to 1 to.indicate a seamless 
connection. 

At step #2378 tiie interieaved allocation flag lAF 
(Fig. 16) is set to 1 in the cell playt>ack information 
blocks C_PBI #i containing tiie VOB control information 
for each scene based on the multi-angle seamless 
switching flag VOB_FsV state, which is set to 1 to indi- 
cate interleaving is required. 



At Step #2380 the location of the navigation pack 
NV (relative sector number from the VOB beginning) is 
detected from the title editing unit (VOB below) obtained 
from the system erlcoder 900 in Rg. 25. the navigation 

5 pack N V is detected based on the minimum interleaved 
unit presentation time ILVU_MT information (a formatter 
parameter obtained in step #1854. Rg. 36), the location 
of the VOBU expressed as the number of sectors from 
the VOB beginning, for example, is thus obtained, and 
10 the titie editing unit VOB is divided into interleave units 
using VOBU units. 

For example, if in this exanple the minimurh inter- 
leaved unit presentation time ILVU_MT is 2 sec and the 
presentation time of one VOBU is 0.5 sec, then the 

IS VOB is divided into interleave units of 4 VOBU each. 
Note that this allocation operation is applied to the VOB 
constituting each multi-scene data uiiit 

At step #2382 tiie interleave units of each VOB 
obtained from step #2380 are arranged in the cell block 

20 mode CBM sequence (cell block b^inning. middle, and 
end cells) written as the VOB control information for 
each scene in step #2360 to form the interleaved blocks 
as shown in Fig, 57 or 58. The interleaved blocks are 
tiien added to ttie VTS title VOBS (VTSTT^VOBS). 

25 Using the cell block mode CBM declarations above, for 
example, the angle data MA1. MA2, and MA3 (Fig. 23) 
are arranged in that sequence, 

Ai step #2384 the relative sector number from the - 
VOBU start is written to the VOB end pack address 

30 VOBU_EA (Fig. 20) in tiie navigation pack NV of each 
VOBU based on tiie VOBU position information 
obtained in step #2360. 

At step #2386 tiie first cell VOBU start address 
C_FVOBU_SA and tiie last cell VOBU start address 

35 C_LVOBU_SA expressed as the number of sectors 
from tiie beginning of tiie VTS titie VOBS 
(VTSTr_VOBS) are written as the addresses of the 
navigation packs NV of tiie first and last VOBU in each 
cell based on the VTS title VOBS (VTSTT^VOBS) data 

40 obtained in step #2382. 

At step #2388 tfie relative sector number from tiie 
VOBU start is written to the VOB end pack address 
VOBU_EA (Rg. 20) in the navigation pack NV of each 
VOBU based on the interleave unit data obtained in step 

45 #2370. 

The angle #i VOBU start address 
SML_AGL_C1_DSTA - SML_AGL_C9_DSTA of the '■ 
seamless angle information SML_AGU (Fig. 20) in tiie 
navigation pack NV of each VOBU is written at step 

50 #2390. This address is expr^sed as the relative sector 
number inside the data of the interleaved blocks formed 
in step #2382. and declares the address informa:tion 
(Fig. 20) of tiie navigation pack NV contained in the 
VOBU of all angle scenes with a start time contiguous to 

55 the reproduction end timfe of the VOBU being proc- 
essed. 

At step #2392 TFFFFFFFh" is written to tfie angle 
#i VOBU start address . SML_AGL_C1_DSTA - 
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SML_AGL_C9„DSTA of the seamless angle informa- 
tion SML_AGLI (Rg. 20) in the navigation pack NV of 
the VOBU contained in the interleaved unit if the inter- 
leave unit an-anged in step #2382 is the last interleave 
unit of each scene in the multi-scene period. 

This routine thus formats the interleaved blocks for 
multi-angle seamless switching control in the multi- 
scene period, and formats the cell control information as 
the reproduction control information for those multiple 
scenes. 

The parental lock subroutine (step #2320, Fig, 40) 
executed when step #2318 In Fig. 40 returns NO, i.e., 
when it is determined that parental lock control is imple- 
mented and not multi -angle control, is described next 
with reference to Fig. 43. 

The parental lock subroutine described below 
writes the interleave unit arrangement of the multimedia 
bitstream, the content of the PGC information entries 
C_PBI #i (cell playback information) shown in Fig. 16. 
and the navigation pack NV information shown in Fig, 
20, to the generated DVD multimedia bitstream. 

At step #2402 a value "OOb" Is written to the cell 
block mode CBM (Fig. 16) of the cell playback informa- 
tion blocks C_PBI #i containing the VOB control infor- 
^ mation for each scene based on the multi-angle flag 
VOB_Fm state, which is set to 0 to indicate that multi- 
angle control is not enabled in the multi-scene period. 

At step #2404 the seamless playback flag SPF (Fig. 
16) is set to 1 in the cell playback information bkx5ks 
C_PBI #i containing the VOB control information for 
each scene based on the preceding VOB seamless 
conn€Ctk>n flag VQB_Fsb state, which is set to 1 to indi- 
cate a seamless connection. 

At step #2406 the STC resetting flag STCDF is set 
to 1 in the cell playback information blocks C_PBI #i 
containing the VOB control information for each scene 
based on the preceding VOB seamless connection flag 
VOB_Fsb state, whfch is set to 1 to indicate a seamless 
connection. 

At st^ #2408 the interleaved allocation flag lAF 
(Fig. 16) is set to 1 in the cell playback information 
blocks C_PBI #i containing the VOB control Information - 
for each scene based on the multi-angle seamless 
switching flag VOB_FsV state, which is set to 1 to indi- 
cate interleaving is required. 

At step #2410 the navigation pack NV position infor- 
mation (the relative sector number from the VOB start) 
is detected from the title editing unit (VOB)^obtained 
from the system encoder 900 (Rg. 25). The navigation 
pack N V is then detected based on the number of inter- 
leaved VOB divisions ILV_DIV, a formatter parameter 
obtained in step #1874 in Fig, 38, to obtain the VOBU 
position information (number of sectors from the VOB 
start), and divide each VOB into the specified number of 
interleave units in VOBU units. 

At step #2412 the interleave units obtained in step 
#2410 are then interleaved. For example, the interleave 
units are arranged in ascending VOB number sequence 
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to create the Interleaved biocks as shown in Fig. 57 or 
58. and the interleaved blocks are added to the VTS title 
VOBS (VTSTT^VOBS). 

At step #2414 the relative sector number from the 
5 VOBU start is written to the VOB end pack address 
VOBU_EA (Rg. 20) in the navigation pack NV of each 
VOBU based on the VOBU position information 
ot>tained in step #2186. 

At step #2416 the first cell VOBU start address 
to C„FVOBU_SA and the last cell VOBU start address 
C_LVOBU_SA expressed as the number of sectors 
from the beginning of the VTS title VOBS 
(VTSTT_VOBS) are written as the addresses of the 
navigation packs NV of the first and last VOBU in each 
IS cell based on the VTS title VOBS (VTSTT_VOBS) data 
obtained in step #241 2. 

At step #2418 the relative sector number to the last 
interleave unit pack is written to the ILVU end pack 
address ILVU^EA in the navigation pack NV of the 
20 VOBU forming the interieaved units based on the inter- 
leaved unit data obtained from step #2412. 

At step #2420, the relative sector number in the 
interleaved block data formed in step #2412 is written to 
the next-ILVU start address NT_ILVU_SA as the posi- 
2S ton information of the next ILVU In the navigation packs 
NV of the VOBU contained in the interleaved unit ILVU. 

At step #2422 the interleaved unit flag ILVU flag is 
set to 1 in the navigation packs NV of the VOBU con- 
tained in the interleaved unit ILVU. 
30 At step ^^424, the Unit END flag of the navigation 
pack NV in the last VOBU of the interleaved unit ILVU is 
set to 1 . 

At step #2426 "FFFFFFFFh- is written to the next- 
ILVU start adcfress NTJLVU_SA of the navigation pack 
35 NV of the VOBU in the last interieaved unit ILVU of each 
VOB. 

The operation described above thus formats the 
interleaved blocks to enable parental lock control in the 
multi-scene periods, and formats the control information 

40 in the cells, i.e.. the cell playback control kifbrmation for 
the multi-scene periods. 

The single scene subroutine executed asi step 
#2314 in Fig. 40 when steps #231 2 or #2316 return NO. 
i.e. , when the scene is determined to be a single scene 

4S and not a multi-scene period, is described next using 
Fig. 44. 

The single scene subroutine desaibed below 
writes the interleave unit arrangement of the multimedia 
bitstream, the content of the PGC information entries 

50 C_PBI #i (cell playback information) shown in Rg. 16, 
and the navigatkn pack NV information shown in Rg. 
20, to the generated DVD multimedia bitstream. 

At step #2430 a value "OOb" indicating a "non-cell 
block", i.e., that there Is only one cell in the functional 

?5 block, is written to the cell block mode CBM (Fig. 1 6) of 
the ceil playtjack information blocks C_PBI #i containing 
the VOB control information for each scene based on 
the multi-scene flag VOB_Fp state, which is set to 0 to 



34 



67 



EP 0 847 195 A1 



68 



indicate that the scene is a single scene and not part of 
a nnulti-scene period. 

At step #2432 the interleaved allocation flag lAF 
(Fig. 16) is set to 0 In the cell playt>ack information 
blocks C_PBI #i containing the VOB control information s 
for each scene based on the multi-angle seamless 
swvitching flag VOB_FsV state, which is set to 0 to indi- 
cate interleaving is not required. 

At step #2434 the navigation pack NV position Infor- 
mation (the relative sector number from the VOB start) io 
is detected from the title editing unit (VOB) obtained 
from the system encoder 900 (Rg. 25), placed in the 
VOBU unit, and added to the VTS title VOBS 
(VTSTT_VOBS), the video and other stream data of the 
multimedia bitstream. is 

At step #2436 the relative sector number from the 
VOBU start is written to the VOB end pack address 
VOBU_EA (Fig. 20) in the navigation pack NV of each 
VOBU based on the VOBU position information 
. obtained in step #2434. 20 

At step #2438 the first cell VOBU start address 
G_FVOBU_SA and the last cell VOBU start address 
C_LVOBU_SA expressed as the number of sectors 
from the beginning of and the end of. respectively, the 
VTS title VOBS (VTSTT_VOBS) of the value written as 2S 
the addresses of the navigation packs NV of the first 
and last VOBU in cell based on the VTS title VOBS 
(VTSTt^VOBS) data obtained in step #2434. 

At step #2440 the state determined as a result of 
step #300 or #600 in Fig. 34, i.e., whether preceding 30 
VOB seamless connection flag VOB_Fsb is set to 1 indi- 
cating a seamless connection to the preceding or «dI- 
lowing scenes, is evaluated. If step #2440 returns-YES. 
the procedure moves to step #2442. 

At step #2442 the seamless playback flag SPF (Fig. 3S 
16} is set to 1 in the cell playback information blocks 
C_PBI #i containing the VOB control information for 
each scene t>ased on the preceding VOB seamless 
connection flag VOB_Fsb state, which is set to 1 to indi- 
cate a seamless connection. 

At step #2444 the STG resetting flag STCDF is set 
to 1 in the cell playback information blocks C_PBI #i 
containing the VOB control information for each scene 
based on the preceding VOB seamless connection flag 
VOB_Fsb state, which is set to 1 . 

If step #2440 returns NO. i.e.. there is not a seam- 
less connection to the preceding scene, the procedure 
moves to step #2446. 

At step #2446 the seamless playback flag SPF (Rg. 
16) is set to 0 in tfie cell playt>ack information blocks 
C_PBI #i containing the VOB control information for 
each scene based on the preceding VOB seamless 
connection flag VOB_Fsb state, which is set to 0 to indi- 
cate a non-seamless connection. 

At step #2446 the STC resetting flag STCDF is set 
to 0 in the cell playback information blocks C_PBI #i 
containing the VOB control information for each scene 
based on ttie preceding VOB seamless connection flag 



VOB_Fsb state, which is set to 0. 

The operation described above tiius formats a mul- 
timedia bitstream for a single scene period, arid records 
the control irtformatioh in the cells, i.e.. the cell playt}ack 
control information (C_PBI #i. Fig. 16). and the inforriia- 
tion in the navigation pack NV (Rg. 20). to the produced 
DVD multimedia bitstream. 

Decoder flow charts 

Disk-to-stream buffer transfer flow 

The decoding information table produced by the 
decoding system controller 2300 based on the scenario 
selection data St51 is described befow referring to Rgs. 
45 and 46. The decoding information table comprises 
the decoding system table shown in Rg. 45, and the 
decoding table shown in Rg. 46. 

As shown in Rg. 45. the decoding system table 
comprises a scenario information register and a cell 
information register. The scenario information register 
records the title number and other scenario reprcxluc- 
tion information selected by the user and extracted from 
the scenario selection data St51. the cell information 
register extracts and recotds the informata'on required to 
reproduce the cells constituting the program chain PGG 
based on the user-defined scenario information 
extracted into the scenario information register. 

More specifically, the scenario information register 
contains plural sub-registers, i.e.. the angle number 
ANGLE_NO_reg, VTS number VTS_NOj.reg. PGC 
number VTS_PGCLNO_reg. audio ID AUDIOjD_r^. 
sub-picture ID SP_lD_reg, and the system clock refer- 
ence SCR buffer SCR_buffer. 

The angle number ANGLE_NO_reg stores which 
angle is reproduced when there are multiple angles in 
the reproduction program chain PGC. 

The VTS number VTS_NO_reg records the number 
. of the next VTS reproduced from among the plural VTS 
40 on the disk. 

The PGC number VTS_PGCLNO_reg records 
which of the plural program chains PGG present in the 
video title set VTS is to be reproduced for parental'iock 
control or other applications. 
45 The audio ID AUDIOJD_reg records which of the 
plural audio streams in the VTS are to be reproduced. 

The sub-picture ID SP_ID_reg records which of tiie 
plural sub-picture streams is to be reproduced when 
there are plural sut)-picture streams in the VTS. 
so The system clock reference SCR buffer SGRibuffer 
is the buffer for temporarily storing the system clock ref- 
erence SCR recorded to the pack header as shown in 
Rg. 19. As described using Fig. 26, this temporarily 
stored system dock reference SCR is output to the 
55 decoding system controller 2300 as the bitstream con- 
trol data St63. 

The cell information register contains ihe following 
sub-registers: the cell block mode CBM_reg. cell biodk 
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type CBT_reg, seamless reprcxJuction flag SPF_reg. 
interleaved allocation flag IAF_reg. STC resetting flag 
STCDF. seamless angle change flag SACF^reg. first 
cell VOBU start address C_f^OBU_SA_reg, and last 
cell VOBU start address C_LVOBU_SA_reg. 

The cell l>lock mode CBM_reg stores a value indi- 
cating whether plural cells constitute one functional 
block. If there are not plural cells in one functional block. 
CBM_reg stores N_BLOCK. If plural cells constitute one 
functional block, the value F_CELL is stored as the 
CBM_reg value of the first cell in the block. L_CELL is 
stored as the CBM_reg value of the last cell in the block, 
and BLOCK is stored as the CBM_reg of value all cells 
between the first and last cells in the block. 

The cell block type CBT_reg stores a value defining 
the type of the block indicated by the cell block mode 
CBM_reg. If the cell block is a multi-angle block. 
A_BLOCK is stored; if not, N_BLOCK is stored. 

The seamless reproduction flag SPF_reg stores a 
value definirig whether that cell is seamless connected 
with the cell or cell block reproduced therebefore. If a 
seamless connection is specified. SML is stored; if a 
seamless connection is not specified, NSML is stored. 

The Interleaved allocation flag IAF_reg stores a 
value identifying whether the cell exists in a contiguous 
or interleaved t>lock. If the cell is part of a an interleaved 
block. ILVB is stored; otherwise NJLVB is stored. 

The STC resetting flag STCDF defines whether the 
system time dock STC used for synchronization must 
be reset when the cell is reproduced; when resetting the 30 
system time clock STC is necessary, STC_RESET is 
stored; if resetting is not necessary. STC_NRESET is 
stored. 

The seamless angle change flag SACF_reg stares 
a value indicating whether a ceil in a multi-angle period 35 
should be connected seamlessly at an angle change. If 
the angle change is seamless, the seamless angle 
change flag SACF is set to SML; othenvise it is set to 
NSML 

The first cell VOBU start address 4o 
C_FVOBU_SA.reg stores the VOBU start address of 
the first cell in a t^lock. The value of this address is 
expressed as the distance from the logic sector of the 
first cell in the VTS title VOBS (VTSTT_VOBS) as 
measured by and expressed (stored) as the number of 
sectors. 

The last cell VOBU start address 
C_LVOBU_SA_reg stores the VOBU start address of 
the last cell in the block. The value of this address Is 
also expressed as the distance from the logic sector of 
the first cell in the VTS title VOBS (VTSTT^VOBS) 
measured by and expressed (stored) as the number of 
sectors. 

The decoding table shown in Figs. 45 and 46 is 
described below. As shown In Figs. 45 and 46. the 
decoding table comprises the following registers: infor- 
mation registers for non-seamless multi-angle control, 
information registers for seamless multi-wangle control, a 



VOBU information register, and information registers for 
seamless reproduction. 

The information registers for non-seamless multi- 
angle control comprise sub-registers 
5 NSML_AGL_C1_DSTA_reg 
NSML_AGL_C9_DSTA_reg. 

NSML_AGL_C1_DSTA_reg 
IMSML_AGL_G9_DSTA_reg record the 

NMSL_AGL_Cr DSTA - NMSL_AGL_C9_DSTA values 
10 in the PCI packet shown in Fig. 20. 

The information registers for seamless multi^ngle 
control comprise sut>-registers 

SML_AGL_G1_DSTA_reg - SML_AGL_C9_DSTA_reg. 
SML_AGL_C1_DSTA_reg - 
IS SML_AGL_C9_DSTA_reg record the 

SML_AGL_C1_DSTA - SML_AGL_C9_DSTA values In 
the DSI packet shown in Fig. 20. 

The VOBU information register stores the end pack 
address VOBU__EA in the DSI packet shown in Rg. 20 
20 The information registers for seamless reproduc- 
tion comprise the following sub-registers: an interleaved 
unit flag ILVUJIag_reg. Unit END flag 
UNIT_ENDJIaa_reg, Interleaved Unit End Address 
ILVU_EA_reg. Next Interleaved Unit Start Address 
NT_ILVU_SA_reg, the presentation start time of the f n-st 
video frame in the VOB (Initial Video Frame Presenta- 
tion Start Time) VOB_V_SPTM_reg, the presentation 
end time of the last video frame In the VOB (Rnal Video 
Frame Presentation Termination Time) 
VOB_V_EPTM_reg. audio reproduction stopping time 1 
VOB_A_STP_PTM1_reg. audio reprodLK;tion stopping 
time 2 VOB_A_STP_PTM2_reg, audio reproduction 
stopping period 1 VOB_A_QAP_LEN1_reg, and audio 
reproduction stopping perfod 2 

VOB_A_GAP_LEN2_reg. 

The interieaved unit flag lLvUJIag_reg stores tiie 
value indicating whether tiie video object unit VOBU is 
in an interleaved WocK and stores ILVU if it is, and 
NJLVUifnot 

The Unit END flag UNIT_ENDJIag_reg stores tfie 
value indicating whether tiie video object unit VOBU is 
tiie last VOBU in ihe interleaved unit ILVU. Because the 
interleaved unit ILVU is tiie data unit for continuous 
reading, the UNIT_ENDJIag_reg stores END if the 
45 VOBU cun-entiy being read Is tfie last VOBU in the inter- 
leaved unit ILVU. and otherwise stores N_END. 

The Interieaved Unit End Address ILVU_EA_reg 
stores the address of the last pack in the ILVU to which 
the VOBU belongs if tiie VOBU is in an Interieaved 
50 block. TWs address Is expressed as the number of sec- 
tors from tiie navigation pack NV of that VOBU. 

The Next Interieaved Unit Start Address 
NTJLVU_SA_reg jstores tiie start address of the next 
interieaved unit ILVU if tiie VOBU is in an interieaved 
55 block This address is also expressed as the number of 
sectors from the navigation pack NV of tfiat VOBU. 

The Initial Video Frame Presentation Start Time 
register VOB_V_SPTM_reg stores tiie time at whfch 
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presentation of the first video frame in the VOB starts. 

The Final Video Frame Presentation Termination 
Time register VOB_V_EPTM_reg stores the time at 
which presentation of the last video frame in the VOB 
ends. 

The audio reproduction stopping time 1 
VOB_A_STP^PTM1_reg stores the time at which the 
audio is to be paused to enable resynchrontzation. and 
the audio reproduction stopping period 1 
V0B_A_GAP_LEN1_reg stores the length of this pause 
period. 

The audio reproduction stopping time 2 
VOB_A_STP_PTM2_reg and audio reproduction stop- 
ping period 2 VOB_A_GAP_LEN2_reg store the same 
values. 

The operation of the DVD decoder DCD according 
to the present invention as shown in Fig. 26 is described 
. next below with reference to the flow chart in Fig. 47, 

At step #31 0202 it is first determined whether a disk 
has been inserted. If it has, the procedure moves to step 
#310204. 

At step #310204. the volume file structure VPS (Fig. 
21) is read, and the procedure moves to step #310206. 

At step #310206, the video manager VMQ (Fig. 21) 
is read and the vkJeo title set VTS to be reproduced is 
extracted. The procedure then moves to step #310208. 

At step #310208, the video title set menu address 
information VTSM_C_ADT is extracted from the VTS 
information VTSI, and the procedure moves to step 
#310210. 

At step #310210 the video title set menu 
VTSM_VOBS is read from the disk based on the video 
title set menu address information VTSM_C_ADT and 
the title selection menu is presented. 

The user is thus able to select the desired title from 
this menu in step #310212. If the titles include both con- 
tiguous titles with no user-selectable content and titles 
containing . audio numbers, sub^icture numbers, or 
multi-angle scene content, the user must also enter the 
desired angle number. Once the user selection is com- 
pleted, the procedure moves to step #310214. 

. At step #310214. the VTS^PGCI #i program chain 
(PGC) data block corresponding to the title number' 
selected by the user is extracted from the VTSPGC 
information table VTS_PGCIT. and the procedure 
moves to step #310216. 

Reproduction of. the program chain PGC then 
begins at step #310216. When program chain PGC 
reproduction is finished, the decoding process ends. If a 
separate titie is thereafter to be reproduced as deter- 
mined by monitoring key entry to the scenario selector, 
the titie menu is presented again (step #310210). 

Program chain reproduction in step #31 021 6 above 
is described in furtfier detail below referring to Fig. 48. 
The program chain PGC reproduction routine consists 
of steps #31030. #31032, #31034, and #31035 as 
shown. 

At step #31 030 tiie decoding system table shown in 



Rg. 45 is defined. The angle number ANGLE__NO__reg, 
VTS number VTS_NO_reg. PGC number 
VTS_PGCLNO_f eg. audio ID AUDIO JD_reg. and sub- 
picture ID SPJD_reg are set according to the selec- 
5 tions made by tiie user using tiie scenario selector 
2100. 

Once the PGC to be reproduced is determined, tiie 
corresponding cell information (PGC information entries 
C_PBI #j) is extracted and the cell information register is 

10 defined. The sub-registers therein that are defined are 
the cell block mode CBM_reg, cell block type CBT_reg, 
seamless reproduction flag SPF_reg. interleaved allo- 
cation flag IAF_reg. STC resetting flag STCDF. seam- 
less angle change flag SACF_reg. first cell VOBU start 

IS address C_FVOBU_SA_reg. and last cell VOBU start 
address C_LVOBU_SA_reg. 

Once the decoding system table is defined, tine 
process transferring data tp tiie stream buffer (step 
#31032) and the process decoding the data in tiie 

20 stream buffer (step #31034) are activated in parallel. 

The process transferring data to the stream buffer 
(step #31032) is the process of tiansferring data from 
the recording medium M to the stream buffer 2400. This 
is, therefore, the processing of reading the required data 

25 from the recording medium M and inputting tiie data to 
the stream buffer 2400 according to the user-selected 
title information and the playback control infbrmatidn 
(navigation packs N V) written in the stream. 

The routine shown as step #31 034 is the process 

30 for decoding the data stored to the stream buffer 2400 
(Fig. 26), and outputting tiie decoded data to tiie video 
data output terminal 3600 and audio data output terhfii-. 
nal 3700. Thus, is the process for decoding and repro- 
ducing tiie data stored to the stream buffer 2400. 

35 Note that step #31032 and step #31034 are exe- 
cuted in parallel. 

The processing unit of step #3 1 032 is the cell- and 
as processing one cell is completed, it is determined in 
step #31035 whether the conplete program chain PGC 

40 has been processed. If processing the complete pro- 
gram chain PGC is not completed, the decoding system 
table is defined for the next cell in step #31030. This 
loop from step #31030 through step #31035 is repeated 
until the entire program chain PGC is processed. , 

45 . ■ '\ 

Decodino process in tiie stream buffer 

The process for decoding data in the stream buffer 
2400 shown as step #31034 in Fig. 48 is described 
50 below referring to Rg. 49. This process (step #31034) 
comprises steps #31110, #31112, #31114. and 
#31116. 

At step #31110 data is transferred in pack units 
from the stream buffer 2400 to the system decoder 2500 
55 (Fig. 26). The procedure then moves to'step #31 112. 

At step #31112 tiie pack data is from the stream 
buffer 2400 to each of the buffers, i.e., the video buffer 
2600, sub-picture tMjffer 2700. and audio buffer 2800. 
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At step #31 112 the Ids of the user-selected audio 
and sub-picture data. i.e.. the audio ID AUDIO JD_reg 
and the sub-picture ID SP_ID_reg stored to the sce- 
nario information register shown in Fig. 45. are com- 
pared with the stream ID and sub-stream ID read from 
the packet header (Fig. 19), and the matching packets 
are output to the respective buffers. The procedure then 
moves to step #31114. 

The decode timing of the respective decoders 
(video, subi3icture, and audio decoders) is controlled in 
step #31114, i.e., the decoding operations of the decod- 
ers are synchronized, and the procedure moves to step 
#31116, 

Note that the decoder synchronization process of 
step #31114 is described below with reference to Fig. 
50. 

The respective elementary strings are then 
decoded at step #31116. The video decoder 3801 thus 
reads and decodes the data from the video buffer, the 
subisicture decoder 3100 reads and decodes the data 
from the sub-picture buffer, and the audio decode 3200 
reads and decodes the data from the audio buffer. 

This stream buffer data decoding process then ter- 
minates when these decoding processes are com- 
pleted. 

The decoder synchronization process of step 
#31114. Fig. 49, is described below with reference to 
Fig. 50. This processes comprises steps #31120, 
#31 122, and #31 124. 

At step #31120 it is determined whether a seam- 
less connection is specified between the current ceil 
and the preceding ceil. If a seamless connectioa the 
procedure moves to step #31 122, if not. the procedure 
moves to step #3 1 1 24. 

A process synchronizing operation for prcKlucihg 
seamless connections is executed in step #31 122. and 
a process syrx;hronizlng operation for non-seamless 
connections is executed in st^ #31 124. 

Spgffial Reprodwtion 

The use of special reproduction modes such as fast 
forward and reverse play from a muHi-scene period as 
shown in Fig. 21 recorded to a recording medium M 
using an interleaved block bitstream arrangement as 
shown in Rg. 58 is considered below. 

The execution of special reproduction noodes such 
as fast forward and reverse ("special-mode reproduc- 
tion" tjelow) using an MPEG bitstream is described with 
reference to Fig. 51. Each block labelled "V" in Fig. 51 
corresponds to one group_of .pictures GOP. During fast 
forward reproduction the reprodi^ction process does not 
reproduce every GOP in the bitstream, but skips GOP in 
the forward direction TRF to discretely select and repro- 
duce GOP data at a regular interval starting from the 
reproduction start position of each selected GOP This 
selection period may be constant or may vary according 
to the GOP selected. A similar process is executed dur- 



ing reverse mode reproduction with the data being read 
in the reverse direction TRB. 

Two methods can be used to discretely select non- 
contiguous GOP from a contiguous bitstream: pre-read- 

5 ing and storing into memory the address information of 
every GOP to be selected and reproduced, or sequen- 
tially dynamically reading the address information of the 
next GOP to be selected during the reproduction proc- 
ess. The former method is impractical because of its 

10 large system memory requirements. As a result, the 
present invention is an improvement of the latter 
sequential address determination method. 

The tatter method can also be achieved in two 
ways: determining the location of the next GOP to be 

IS reproduced based on the bitstream rate or other con- 
stant factors, or recording the address of the next GOP 
according to the reproduction speed to the bitstream 
together with the audio and video data, and extracting 
this address information during reproduction. 

20 Furthermore, if all frames in each of the discretely 
selected GOPs Is reproduced, a particular number of 1- 
frames or P-f rames in the GOP will be selected and 
reproduced. During such special reproduction modes 
only part of the data in the bitstream is usually decoded 

25 and displayed. 

However, if sharing plural system streams with a 
common system stream is permitted as shown in the 
multi-scene periods in Fig. 21 , Fig. 30, and Fig. 31 . spe- 
cial-mode reproduction cannot be easily accomplished. 

30 For example, when the address of the next GOP is 
sequentially determined when branching from the com- 
mon scene to one of the plural system streams in the 
multi-scene period (one of the multiple angle scenes or 
parental lock control scenes), it is possible to calculate 

35 the address of the next GOP from the bit rate when the 
branch destination is contiguously arrayed. When the 
branch destination is not contiguously arrayed, how- 
ever, this calculation is not possible. In addition, if the 
address of the next GOP is recorded as an address on 

40 only one of the plural possible reproduction paths, it is 
not possible to follow the other reproduction path 
branch, and this is not acceptatsle. Furthermore, the 
available disk capacity cannot be efficiently used if all 
possible branch destinations are recorded. As the 

45 number of common scenes increases, the number of 
branch destinations to be recorded also increases, data 
generation (coding) becomes more complex, and cod- 
ing becomes impractical. 

As a result. It becomes difficult to follow the 

so selected reproduction path during fast forward repro- 
duction of only one multi-scene reproduction path. It is 
accordingly also diff icutt to follow the selected reproduc- 
tion path during reverse reproduction of only one multi- 
scene reproduction path. 

55 When VOB-B, VOB-C, and VOB-D are interleaved 
as shown in Fig. 57 to enable seamless reproduction 
between common scenes and the selected reproduc- 
tion path from a multi-scene period for parental lock 
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control or multi-angle scene selection, it is even more 
difficult to dynamically calculate the address of the next 
GOR As a result, achieving fast forward or reverse 
mode reproduction at system stream branches and con- 
nections is still difficult, just as when interleaving is.not 5. 
used. 

Therefore, the object of the present invention is to 
provide a multimedia optical disk whereby special repro- 
duction modes can be accomplished even when the 
cells forming plural program chains share selected VOB 10 
or when the system streams are divided into plural VOB 
interleaved in interleaved units ILVU; a recording 
method and a reproduction method for recording and 
reproducing said multimedia optical disk; and a record- 
ing apparatus and a reproduction apparatus implement- is 
ing said recording method and reproduction method, 
respectively 

The present invention also provides a data struc- 
ture whereby special reproduction modes such as fast 
forward and reverse play can be achieved, and the data 20 
can be easily produced, for a digital video disk system ^ 
even when common VOB are used to form plural pro- 
gram chains; 

This data structure is characterized by recording 
both the cell start address and end address information 25 
to the cell reproduction information to enable reverse 
mode reproduction. To enable high speed special mode 
reproduction, the skip destination address records an 
address within the same cell or an address indicating an 
address outside the cell (e.g., an address value that is 30 
invalid as a DVD relative address), and each ceil is 
therefore independent of every other cell. The data of 
each cell can therefore be easily generated even when 
cells are shared by plural program chains PGC. 

The first emtjodiment of the presertt invention is 35 
described below. 

To enable high speed special-mode reproduction in 
this first embodiment, information indicating an address 
beyond the cell border is recorded when the address of 
the skip destination is outside the cell. 40 

The relative sector information used to rapidly move 
according to the reproduction speed to the sector of the 
VOBU containing the next GOP during fast forward or 
reverse mode reproduction of bitstream data according 
to the present invention is described below with refer- 45 
ence to Rg. 32. This relative sector information is 
recorded in the present invention as the VOBU search 
information VOBU_SRI of the navigation pack NV The 
data structure of this bitstream is as previously 
described with reference to Fig. 22 and Fig. 1 6. and the so 
structure of the navigation pack NV is as described with 
reference to Fig. 20 and Rg. 32, Only the VOBU search 
information VOBU_SRI is therefore described below. 

The VOBU search information VOBU_SRI com- 
prises search information (FWDIn. FWDI Next) used.for ss 
reproduction in the normal direction, i.e.. fast fonward 
direction, and search information (BWDIn, BWDI Prev) 
used for reproduction in the reverse direction. 



The index n to tiie FWDI and BWDI addresses 
declares the relative reproduction time from tiie VOBU 
containing the navigation pack NV where the reproduc- 
tion time corresponds to 0.5 sec. x n. For example, 
FWDI 120 declares the relative sector address of the 
VOBU reproduced 60 sec. later during normal repro- 
duction. FWDI Next declares the relative sector address 
of the next VOBU, and BWDI Prev declares the relative 
sector address of the preceding VOBU. 

VOBU search information VOBU_SRI parameters 
FWDI 1 - 240, FWDI Next, BWDI 1 - 240. and BWDI 
Prev do not record address information for any VOBU 
outside the cell containing that navigation pack NV. 
More specifically, if the data that would be accessed at 
the relative reproduction time from the VOBU of the cell 
for which the navigation pack NV is bang written is out- 
side that cell, tiie FWDI and BWDI record a value simply 
indicating that the destination address is outside the 
current cell, and do not record a valid address value. 
This value may be, for example. "3FFFFFFFh." An 
address enabling VOBU to be sanrpled and reproduced 
at a regular interval, i.e.. an address enabling high 
speed reproduction, is thus recorded. 

Reproduction of a digital video cfisk and prograril 
chain PGC by means of the decoding system controller 
2300 of the DVD decoder DCD according to ttie present 
invention Is described next with reference to Rg. 47 and 
Rg.52. 

The DVD reproduction process is shovvn in Fig. 47. 
When the digital video disk is inserted, the video titie set 
VTS information to be reproduced is extracted,- the 
VTS_PGGI #i program chain (PGC) diata block conre- 
sponding to the titie number selected by the user is 
extracted from the VTSPGC information table 
VTS_PGCIT, and the selected scenario is reproduced 
according to tiie VTS.PGCt #i program chain informa- 
tion. Fig. 47 has already been descrbed above, and fur- 
ther description thereof is thus omitted below. 

The process of the decoding system controller 
2300 when a special reproduction mode such as fast 
forward or reverse, play is selected by the user during 
: reproduction according to the program chain informa- 
tion is described below with reference to Fig. 52. 

At step #331202 tiie VOBU search information 
VOBU_SRI is read from the DSl packet data of ttie 
VOBU navigation pack NV from the stream buffer 2400^ 
as the data currently being reproduced in the VTS'titie 
VOBS (VTSTT_VOBS) based on the VTS.PQCI #i pro- 
gram chain information. 

At step #331203 the decoding system controller 
2300 sets the address Adsi to the VOBU search infor- 
mation VOBU_SRI of the navigation pack NV of ttie next 
VOBU to be reproduced based on tiie reproduction 
mode. i.e.. whether normal or special-mode reproduc- 
tion, and ttie reproduction speed of fost forward and 
reverse reproduction operations. As described with ref- 
erence to Fig. 32. if the reproduction mode is normal 
reproduction, tfie address Adsi value is set to tiie F^DI 



39 



77 



EP 0 847 195 A1 



78 



Next parameter declaring the next DS! packet address 
(Fig. 32). If fast forward, reverse, or other special repro- 
duction mode is executing, the address Adsi is set to the 
other VOBU search information VOBU_SRI parameters 
(FWDI 1 -240. BWDI 1 - 240) according to the repro- 5 
duction speed. 

At step #331204 it is determined whether the next 
data to be reproduced is valid based on the address 
Adsi value obtained in step #331203, As a result, a 
value greater than the highest possible address value of ri 
the volume space VS of the recording medium M is 
used as the address Adsi value. Assuming that a single- 
side, single-layer disk is used by way of example only, 
the value SFFFFFFFh is used. If YES is returned in this 
step it is determined that the data to be reproduced is u 
not data within the same cell. i.e.. not data within the cell 
range declared to C_PBI, and the procedure moves to 
step #331206. If NO is returned, data to be reproduced 
remains, and the procedure moves to step #331205. 

At step #331205 the navigation pack NV specified 2c 
by the address Adsi is accessed, and the bitstream pro- 
ducer 2000 is controlled to read the VOBU following that 
navigation pack NV. The read data is also transferred to 
the stream buffer 2400. If fast forward, reverse, or other 
special reproduction mode is selected, data that is not 2S 
displayed for the VOBU currently being reproduced and 
stored in the stream buffer 2400 is destroyed when data 
is transferred to the stream buffer 2400. and operation 
downstream from the system decoder 2500 is inter- 
rupted. As a result, only data for the frames to be dis- 30 
played during high speed reproduction is supplied to the 
system decoder 2500. and smooth high speed repro- 
duction can be achieved. 

At step #331206 it is determined whether the repro- 
duction mode is fon^ard or reverse. If fonvard. the pro- 3S 
cedure moves to step #331207; if reverse, the 
procedure moves to step #331210. 

At step #331207 the j parameter indicating the 
reproduction cell sequence in the VTS_PGCI #i 
extracted at step #310214, Fig. 47, i.e.. the PGC infer- 40 
mation C_PBI #j declaring the cell cun-ently being 
accessed and reproduced, is incremented 1 G + 1). 

At step #331208 it is determined whether the cell to 
be reproduced in the normal direction is valid based on 
the VTS_PGCI #i program chain Information extracted 4S 
at step #310214 and the reproduction cell sequence j 
obtained in step #331207. 

if the next cell reproduction information C_PBI is 
not in the VTS_PGCI #i program chain information 
based on C_PBI result obtained in step #331207, the so 
process terminates. If the cell continues based on the 
C_PBI result obtained in step #331207. i.e.. if PGC 
information C_PBI #i+1 as specified by the reproduction 
cell sequence j parameter obtained in step #331207 
exists, the procedure moves to step #33 1 209. 55 

At step #331209 tiie first cell VOBU start address 
C.FVOBU^SA at VOBU j from tiie cell reproduction 
information C_PBI of program chain information 



VTS_PGCI #i is read and assigned to address Adsi, and 
tiie procedure moves to step #331205. 

At step #331210 tiie cell preceding tiie currentiy 
reproduced cell in normal reproduction is reproduced. 
At step #33121 1 it is determined whether tiie cell to 
, be reproduced in the reverse direction is valid based on 
the program chain information VTS_PGCI #i extracted 
at step #310214. More specifically, if the cell reproduc- 
tion information C_PBI #j defined by the j parameter 
? decremented in step #331210 is recorded to ttie pro- 
gram chain information VTS_PGCI, it is known that tiie 
cell to be reproduced next in reverse sequence is valid, 
and the procedure moves to step #331211. If said cell 
reproduction information C_PBI ^ is not recorded to the 
• program chain information VTS_PGCI. it is known tiiat 
the cell to be reproduced next in reverse sequence is 
not valid, i.e.. reverse reproduction is completed, and 
the process terminates. 

At step #331212 the last cell VOBU start address 
C_LVOBU_SA at VOBU j from tiie cell reproduction 
information C_PBI of program chain information 
VTS_PGCI #i is read and assigned to address Adsi, and 
the procedure moves to step #331205. 

By executing the steps of the above process, tiie 
decoding system controller 2300 reproduces one pro- 
gram chain. 

The above process also enables special-mode 
reproduction of each program chain when plural pro- 
gram chains share cohimon scenes as shown in Fig. 
30. 

An example of VOBU reproduction in each cell dur- 
ing special-mode reproduction from plural program 
chains comprising common scenes and scenes unique 
to specific reproduction paths according to the present 
invention is described below with reference to Rg. 53 
and Fig. 54. 

In these figures the left group represents VOB #5 
corresponding to the common cell, i.e., cell reproduction 
information C_PBI #5. of program chains VTS_PGCl #1 
and VTS_PGCI #2 shown in Rg. 30 and Rg. 31 . 

The top group represents VOB #6 corresponding to 
C^PBI #6 of program chain VTS_PGCI #1 . 

The bottom group represents VOB #7 correspond- 
ing to C_PBI #6 of program chain VTS_PGGI #2. 

The right group represents VOB #8 corresponding 
to C_PBI #7 common to program chains VTS_PGCI #1 
and VTS_PGGI #2. 

Patti A in Rg. 53 represents tiie reproduction patii 
of C_PBI #5 - C_PBI #7 in program chain VTS_PGCI 
#1. and path B represents tiie reproduction path of 
C_PBI #5 - C_PBI #7 in program chain VTS_PGCI #2. 
Note that one cell corresponds to one VOB in tfiis exam- 
ple. 

The DSI frames of each block indicate the naviga- 
tion pack NV containing the DSI packet information, and 
thus contains the VOBU search information. This packet 
is refen-ed to as tiie DSI packet in tiie description below. 

The video packets are labelled V in the figures, and 
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each VOBU comprises plural video packets. In Fig. 53 
and Fig. 54 one VOBU contains two video packets. 

The audio packets are labelled A in the figures. The 
audio data of a reproduction time corresponding to one 
VOBU is divided into plural audio packets for recording, s 
In Fig. 53. Fig. 54, and Fig. 55 one audio packet corre- 
sponds to one VOBU. 

The sub-picture data packets are labelled SR 

Fig. 53 shows the operation in which alternating 
VOBU data units are reproduced during fest forward io 
reproduction. 

The address of the next DSI packet is obtained from 
the VOBU search information in the first DSI packet 
C_PBI #5, i.e:. the VOB #5 common to two program 
chains. After reproducing a particular amount of data is 
from the first VOBU. the VOBU containing the next DSI 
packet (third DSi packet in C_PBI #5) is reproduced. 

When the address of the next DSI packet is read 
from the VOBU search information of this DSI packet 
the value 3FFFFFFFh is obtained. As a result, if 20 
VTS.PGCI #1 of path A is being reproduced, the 
address of the first DSI packet in C_PBI #6 (VOB #6) of 
VTS_PGCI #1 is obtained from the program chain infor- 
mation, and the first DSI packet in C_PBI #6 (VOB #6) 
is read after reproducing a particular number of video 25 
packets from the VOBU containing the third DSI packet 
inC_PBI#5. 

it is thus possible to follow a particular, program 
chain during special reproduction modes. 

How the video packets are reproduced, i.e.. 3d 
whether only the l-frames or P-frames from a GOP are 
reproduced, and from which VOBU reproduction begins 
when reproducing the first video data from an accessed 
cell, will vary according to the speed of the special 
reproduction mode, 35 

Fig. 54 is an example of reverse mode reproduction 
at normal speed starting from the end of C.PBI #7 con- 
taining the VOB #8 comnridn to two program chains. 

The VOBU search information of the last DSI 
packet in G_PB1 #7 (VOB #8) is first read, the address 40 
of the one DSI packet therebefore is obtained, a partic- 
ular number of: video packets is reproduced from the 
VOBU containing the last DSI packet, and the preceding 
DSI packet is read. The address of the OS} packet 
before that DSI packet is similarly obtained, and the 
VOBU is reproduced. 

This is continued until the VOBU search information 
of the preceding DSI packet is read from the first DSI 
packet VOBU search information in C_PB1 #7. In this 
case, the address value SFFFFFFFh is obtained. Thus, 
if path C is being reproduced, the address of the naviga- 
tion pack NV containing the last DSI packet in G_PBI #6 
is obtained from program chain information VTS_PGCI 
#1. More specifically, this address is the last ceil VOBU 
start address G_LVOBU_SA in cell reproduction infor- 
mation C_PBI. As a result, a particular number of video 
packets is reproduced from the VOBU containing the 
last DSI packet in C^PBI #6. 



It is thus possible to follow a particular program 
chain in reverse during spedal reproduction modes. 
The operation of special reproduction modes from plural 
program chains containing common scene information 
is described above. 

When cells are interleaved for seamless reproduc- 
tion between cells, the interleaved blocks are VOBU 
units, arxj the VOBU search information VOBU_SRl can 
still be recorded to the navigation pack NV of each 
VOBU. The relative address information written to the 
VOBU search information can thus be used to enable 
special-mode reproduction in botii forward and reverse 
directions of cells shared by plural program chains using 
the same method as for ceils arrayed to a contiguous 
block. The difference is tfiat a greater distance is moved 
between cells conpared with contiguously arrayed 
cells. 

The method of producing the data structure of tiie 
present invention is described next. This data structure 
is basically generated by simply following the encoder 
flow chart shown in Fig. 34 to Fig. 44. The differences in 
the encoding operation are handled by a slight modifica- 
tion of the processes shown in Fig. 41 , Fig. 42. Fig. 43. 
and Rg. 44. In addition to recording the end pack 
address VOBU^EA to the VOBU navigation pack NV. 
the VOBU search information shown in Rg. 32 is also 
recorded. The VOBU search information recording 
process is described below by describing the differ^ 
ences in these flow charts. 

At step #2356 of the multi-angle seamless switch- 
ing formatting flow chart in Fig. 41 , the VOBU navigation 
pack NV address corresponding to the VOBU search 
information VOBU_SRl shown in Fig. 32 is recorded 
together with the first cell VOBU start address 
C_FVOBU_SA and ttie last cell VOBU start address 
C_LVOBU_SA based on the VTS titie VOBS 
(VTSTT_VOBS) data obtained in step ^^352 and the 
VOBU information obtained in st^ #2350. If the VOBU 
search information VOBU_SRl points outside the cell, 
ttie FWDIn and BWDln values record 3FFFFFFFh. 

The multi-angle seamless switching formatting flow . 
chart iri Rg. 42 is thus similar to tiie multi-angle seam- 
less switching formatting fbw chart in Fig. 41, At step 
#2386, Rg. 42, the VOBU navigation pack NV address 
45 corresponding to the VOBU search information 
VOBU_SRI shown in Fig. 32 is recorded together with 
ttie first ceir VOBU start address C_Fv6bu_SA and the 
last cell VOBU start address C_LVOBU_SA are written 
based on ttie VTS titie VOBS (VTSTT_VOBS) data 
50 obtained iri step #2382 and the VOBU information 
obtained in step #2380. If the VOBU search information 
VOBU_SRI points outside the cell, ttie FWDIn and 
BWDln values record 3FFFFFFFh. 

The multi-scene formatting flow chart for parental 
55. lock control in Rg. 43 is also similar. At step #241 6. Rg. 
43, the VOBU navigation pack NV address conespond- 
ing to ttie VOBU search information VOBU_SRI shown 
in Fig. 32 is recorded togettier witii the first cell VOBU 
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Start address C_FVOBU_SA and the last cell VOBU 
start address C_LVOBU_SA based on the VTS title 
VOBS (VTSTT_VOBS) data obtained in step #2412 and 
the VOBU Information obtained in step #2410, If the 
VOBU search information VOBU_SRi points outside the s 
cell, the FWDIn and BWDIn values record 3FFFFFFFh. 

The single scene formatting flow chart in Rg. 44 is 
also similar. At step #2438 the VOBU navigation pack 
NV address corresponding to the VOBU search infor- 
mation VOBU_SRI shown in Fig. 32 is recorded io 
together with the first cell VOBU start address 
C_FVOBU_SA and the last cell VOBU start address 
C_LVOBU_SA based on the VOBU information 
obtained in step #2434. If the VOBU search information 
VOBU_SRI points outside the cell, the FWDIn and is 
BWDIn values record 3FFFFFFFh. 

The data structure according to the first embodi- 
ment of the present invention can thus be produced. 
A second embodiment is described below. 
In the first embodiment akx^ve the skip destination 20 
address enabling high speed special-mode reproduc- 
tion records a value iridlcating an address outside the 
current cell when the skip destination is in another cell. 
In the second embodiment however, the skip destina- 
tion address enabling high speed special-mode repro- 25 
duction is limited to an address within the current cell 
(not going outside the cun-ent cell). 

The second embodiment is thus substantially iden- 
tical to the first embodiment above, and only the differ- 
ences are descrtoed below. 30 

The logical structure of the optical disk in tNs sec- 
ond embodiment differs from that of the first embodi- 
ment in recording the VOBU search information 
VOBU_SRI declared in the DSI packet address informa- 
tion of the navigation pack NV. In the second embodi- 35 
ment the VOBU search information VOBU_SRI of the 
navigation pack N V does not record an address pointing 
to any cell other than that to which the navigation pack 
NV belongs; this is the same as in the first embodiment. 
What differs is that the VOBU search information 40 
VOBU_SRI of tfie navigation packs NV of ttie VOBU 
between the two end VOBU in the cell record the 
addresses of the navigation packs NV of said two end 
VOBU when the next VOBU to be reproduced during 
special-mode reproduction is outside the borders of the 4s 
current cell. 

For example, when BWD Prev. BWD60, BWD20, 
BWD19. BWD2, and BWD1 related to reverse repro- 
duction exceed the cell tiorders, the address of the nav- 
igation pack N V in the first VOBU in the cell is recorded, so 
Likewise, when F\ND NT, FWD60, FWD20. FWD19. 
FWD2. and FWD1 related to fast fonward reproduction 
exceed the cell borders, tfie address of the navigation 
pack NV in the last VOBU in the cell is recorded. 

In the navigation pack NV of the first VOBU in the 
cell, the BWD Prev. BWD60. BWD20, BWD 19. BWD2, 
and BWD1 fieWs related to reverse reproduction record 
an address value of 0. In the navigation pack NV of the 



last VOBU in the cell, the FWD NT, FWD60. FWD20, 
FWD19, FWD2, and FWD1 related to fast fon^^ard 
reproduction likewise record an address value of 0. 

As a result, addresses pointing to different cells are 
not recorded to ttie VOBU search information 
VOBU_SRI in the navigation pack NV of any VOBU in 
the cell. As a result, it is not necessary to change the 
VOB data forming the cells when cells are used by 
another program chain, and data generation is sinple. 

The reproduction apparatus of the second embodi- 
ment is the same as that of the first embodiment, and 
furtiier description thereof is thus omitted below. 

A flow chart of the decoding system cohti'oller is 
shown in Fig. 56. Note that this process is substantially 
identical to that shown in Fig. 52. Only the differences 
are described below. 

Where it is determined at step #331204 in Fig. 52 
whether tine address is 3FFFFFFFh, it is determined 
whether the address is 0 in Rg. 56. All other processes 
are the same. Thus, the method of determining whether 
tiie cell border is exceeded checks whether tfie address 
Adsi of the. next skip destination extracted from the 
VOBU search information is 3FFFFFFFh in the first 
embodiment, but determines whetiier the address Adsi 
is 0 in the second embodiment. In addition, the naviga- 
tion pack NV of tile last VOBU in tiie cell is always read 
during fast forward reproduction, and the navigation 
pack NV of the first VOBU ts always read in reverse 
reproduction. 

The reproduction process of the program chain 
information VTS_PGCI #i does not differ because of ttiis 
difference. However, because the data that is actually 
output differs, the program chain reproduction method 
during special reproduction modes is described t»elow. 
Fig. 53 corresponds to the program chain reproduction 
method during special reproduction modes in the first 
embodimerrt, and Fig. 55 corresponds to the program 
chain reproduction method of the second embodiment. 

In Fig. 55 as in Fig. 53. the left group represents 
VOB #5 con-esponding to the common cell, i.e., cell 
reproduction information C_PBI #5, of program chains 
VTS^PGCI #1 and VTS^PGCI #2 shown in Rg. 30 and 
Fig. 31. 

The top group represents VOB #6 corresponding to 
C_PBI #6 of program chain VTS^PGCI #1 . 

The bottom group represents VOB #7 correspond- 
ing to G^PBI #6 of program chain VTS_PGCI #2. 

The right group represents VOB #8 corresponding 
to C_PBI #7 common to program chains VTS_PGCi #1 
and VTS^PGCI #2. 

Path A in Rg. 55 represents the reproduction path 
of C_PBI #5 - C_PBI #7 in program chain VTS^PGGI 
#1, and path B represents the reproduction patfi of 
C_PBI #5 - C_PB1 #7 in program chain VTS^PGCI #2. 
Note that one cell corresponds to one VOB in tfiis exam- 
ple. 

What differs in Fig. 55 and Fig. 53 is that the navi- 
gation pack NV of tfie end VOBUs in each cell are 



42 



83 



EP 0 847 195 A1 



84 



always read and reproduced during reproduction on 
both paths A and B. 

How the video packets are reproduced, and from 
which VOBU reproduction begins when reproducing the 
first video data from an accessed cell, will vary accord- s 
ing to the speed of the special reproduction mode. This 
is the same as in the first embodiment atx^e. The same 
is true during reverse reproduction in the second 
emtKxiiment: even if the reverse reproduction speed 
changes, the navigation pack NV of the first VOBU in io 
the cell is always extracted and reproduced during 
reproductton. 

The operation of special reproduction modes from 
plural program chains containing common scene infor- 
mation is d^cribed above. 15 

Also in the second embodiment as in the first 
embodiment, when cells are interleaved for seamless 
reproduction between cells, the interleaved blocks are 
VOBU units, and the VOBU search information 
VOBU_SRI can still be recorded to the navigation pack 20 
NV of each VOBU. The relative address information 
written to the VOBU search information can thus be 
used to enable special-mode reproduction in t)oth for- 
ward and reverse directions of cells shared by plural 
program chains using the same method as for cells 2S 
arrayed to a contiguous block. The difference is that a 
greater distance is moved between cells compared with 
contiguously arrayed cells. 

The method of producing the data structure of the 
present invention is described next. This data sti-ticture 30 
is basically generated by simply following the encoder 
f k3w chart shown In Rg. 34 to Fig, 44. The differences in 
the encoding operation are handled by a slight modifica- 
tion of the processes showvn in Rg. 41 , Rg: 42; Rg. 43, 
arKi Rg. 44. In addition to recording the end pack 35 
address VOBU^EA to the VOBU navigation pack NV. ■ 
the VOBU. search irilprmation shown in Rg. 32 is also 
recorded. The VOBU search infoi-matlon recording 
process is described below by ^describing- the differ- 
ences in these flow charts. 40 

At Step #2356 of the multi-angle seamless switch- 
ing fbrnrtatting flow chart in Rg. 41 . tiie VOBU navigation 
pack NV address corresponding to the VOBU search 
information VOBU_SRI shown in Rg. 32 is recorded 
together with the first cell VOBU start address 45 
G_FVOBU_SA and the last cell VOBU start address 
C_LVOBU_SA based on the VTS title VOBS 
(VTSTT_VOBS) data obtained in step #2352 and ttie 
VOBU information obtained in step #2350. If the VOBU 
search information VOBU_SRi points outside tine cell, so 
the FWDln and BWDln values of VOBU between ttie 
steirt and end VOBU record the cell end VOBU 
addresses, and the FWDln and BWDln values of the 
cell end VOBU record 0. 

The multi-angle seamless switching formatting ftow ss 
chart in Fig. 42 is tiius similar to the multi-angle seam- 
less switching formatting flow cfiart in Rg. 41. At step 
#2386. Rg. 42. tiie VOBU navigation pack NV address 



corresponding to the VOBU search information 
VOBU_SRI shown in Fig. 32 is recorded together with 
the first cell VOBU start address G_FVOBU_SA and tiie 
last cell VOBU start address C_LVOBU_SA are written 
based on the VTS title VOBS (VTSTT_VOBS) data 
obtained in step #2382 and the VOBU information 
obtained in step #2380. If the VOBU search information 
VOBU.SRI points outside the cell, tiie FWDln and 
BWDln values of VOBU between the start and end 
VOBU record the cell end VOBU addresses, and the 
FWDln and BWDln values of the cell end VOBU record 
0. 

The multi-scene formatting flow chart for parental 
lock confrol in Rg. 43 is also similar. At step #2416, Rg. 
43. the VOBU navigation pack NV address correspond- 
ing to tiie VOBU search information VOBU_SRI shown 
in Rg. 32 is recorded together with the first cell VOBU 
start address C_FVOBU_SA and the last cell VOBU 
start address C_LVOBU_SA based on the VTS titie 
VOBS (VTSTT_VOBS) data obtained in step #241 2 and 
tiie VOBU information obtained in step #2410. If tiie 
VOBU search information VOBU_SRI points outside the 
cell, tiie FWDln and BWDln values of VOBU between 
tiie start and end VOBU record the cell end VOBU 
addresses, and the FWDln and BWDln values of the 
cell end VOBU record 0. ' 

The single scene formatting flow chart in Rg. 44 is 
also similar. At step #2438 the VOBU navigation pack 
NV address corresponding to the VOBU search infor- 
mation VOBU_SRr shown in Rg. 32 is recorded 
together with tiie first cell VOBU start address 
C_FVOBU_SA and tiie last cell VOBU start address 
C_LVOBU_SA based on the VOBU information 
obtained in step #2434. If the VOBU search information 
VOBU_SRI poinfe outside the cell, ttie FWDln and 
BWDln values of VOBU between the start and end 
VOBU record ttie cell end VOBU addresses, and the 
FWDln and BWDln values of the ceil end VOBU record 
0. 

The data structure according to the second embod- 
iment of the present invention can thus be produced. 

By meians of the preisent invention thus d^cribed. 
plural program chains can be adapted to provide a 
parental lock control feature whereby, for example, the 
first program chain VTS_PGCI #1 is an adult-oriented 
program chain, the other program chain VTS_PGCI #2 
is a child-oriented program chain, arid forward and 
reverse special reproduction modes can be achieved on 
lX5th program chains. 

In a program chain comprising a multi-angle scene- 
period, each angle is one cell in the digital video disk 
system, and special-mode reproduction 's therefore 
possible within each angle. Furthermore, moving from a 
common cell to one of the multi-angle cells during spe- 
cial-mode reproduction can be achieved by moving to a 
default cell or to the cell corresponding to a user-clef ined 
angle number. Moving from one of the mutti -angle cells 
to a common cell can also be achieved using the same 
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control method used for parental lock control. 

While the data search information interleaved to the 
system stream is described above as being interleaved 
in GOP units, the data compression unit, the interleave 
unit for the data search information packet shall not be s 
limited to the GOP unit 

Furthermore, while the Invention has been 
described with reference to a DVD read-only disk 
recording medium, rewritable media can be used to the 
same effect. 

Furthermore, the menus are primarily a means of 
eliciting user selections, and menu manipulation shall 
not be limited to the keypad of a remote control device 
Manipulation by. for example, a mouse or voice com- 
mands is also possible. 

Furthermore, while the invention has been 
described with particular reference to the MPEG stand- 
ard, future extension of the standard or introduction of 
new standards shall also be covered by the present 
invention Insofar as plural data units are interleaved and 20 
reproduced according to a time-base. 

Furthermore, the invention has been described with 
particular reference to Interleaving one compressed 
vkJeo data unit but the invention shall not be so limited. 

Furthermore, the special reproduction mode infor- 2s 
mation has been described as being written to the data 
search information and interleaved to the system 
stream, but it is only necessary to record the special 
reproduction mode information as information attached 
to the reproduced video data and audio data, and it is 30 
specifically not necessary to interleave tiiis information 
to tile system stream. For exanple. if all special repro- 
duction mode information for the cell is recorded at the 
cell start or to ttie same predefined location, tfie infor- 
mation can be accessed when required witti no change 35 
in the effects described above. 

Ukewise. it inportant tfiat tfie program chain infor- 
mation be read separately from tfie data actually repro- 
duced, and tfie location to which tfie program chain 
information is recorded shall not be limited to tiiat 40 
described above. 

Furttiemiore. the above embodiments assume ttiat 
tfie data at tiie cell start is tfie packet containing the data 2 
r search information, but the data search information 
need not necessarily be recorded to tfie cell start Inso- 4s 
far as tfie related video data, audio data, and sub-pic- 
ture data can be identified, tfie data search information, 
video data, audfo data, and sub-picture data can be 
recorded in any defined sequence. 

Furtfiermore. metfiods other tfian described above so 
can be us^ for intra-cell reproduction and inter-cell 
reproduction during spedal reproduction modes. What 
IS important to tfie invention is that program chain infor- 
mation be used for inter-cell reproduction, and address 
information recorded to tfie special reproduction mode 55 
information, specifically address values SFFFFFFFh 0 
or other "outside cell" value, be used to detect the cell 
ends. 



Even when cells are shared by plural program 
chains, special reproduction modes such as fast for- 
ward and reverse pfay can also be achieved along any 
selected program chain. 

Industrial Applicability 

As is apparent from a metfiod and an apparatus 
according to tfie present invention for interleaving a bit- 
stream to record tfie interleaved bitstream to a record- 
ing medium and reproduce tfie recorded bitstream 
tfierefrom is suitable for tfie application of an authoring 
system which can generate a new title by editing a title 
constructed by bitstrea^ns carrying various information 
in accordance witfi tfie user's request, and is also suita- 
ble for a Digital Video Disk System, or DVD System 
being developed recentiy. 

Claims 

1. A multimedia optical disk (M) comprising at least 
one information layer (RS). wherein a plurality of 
system streams (VOB) interleaving in GOP units 
data containing at least moving picture data, and 
reproduction control information containing trick 
play information (VOBU^SRI) declaring tfie 
address of next data to be reproduced according to 
a special reproduction mode used, and a plurality of 
program chain information (VTS_PGC) declaring 
tfie system stream reproduction sequence of a pro- 
gram chain conprising more than one system 
stream, are recorded to said information layer (RS), 
wherein at least one system stream (CELL, C_PBI) 
is shared by a plurality of program chains 
(VTS_PGC). and address information of data of 
first (C^FVOBU^SA) of each system stream, and 
address information of last (C_LVOBU_SA) repro- 
duction control information in each system stream 
are recorded to tfie program chain information 
(VTS^PGC) according to a system stream repro- 
duction sequence (C_PBI). 

. A multimedia optical disk (M) comprising at least 
one information layer (RS). wherein a plurality of 
system streams (CELL) interleaving in GOP units 
data containing at least moving picture data, and 
reproduction control information containing trick 
play information (VOBU^SRI) declaring tfie 
address of tfie next data to be reproduced accord- 
ing to the special reproduction mode used, and a 
plurality of program chain information (VTS_PGC) 
declaring tfie system stream (CELL) reproduction 
sequence in a program chain comprising more than 
one system stream (CELL), are recorded to said 
information layer (RS). characterized by at least 
one system stf-eam (CELL) being shared by a plu- 
rality of program chains (VTS_PGC). and either 
address information (relative address in tfie 
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VOBU_SRI) in the system stream containing the 
. r^roduction eontrol information (NV) recording the • 
trick play information (VOBU_SRI), or a value 
(3FFFFFFFh in the VOBU_SRI) indicating an 
address outside the system stream, being recorded 5 
to the address information written to the trick play 
information (VQBU.SRI) of the reproduction control 
information. 

3. A multimedia optical disk (M) comprising at least 10 
one information layer (RS). wherein a plurality of 
system streams (CELL) interleaving in GOP units 
data containing at least moving picture data, and 
reproduction control information (NV) containing 
trick, play information (VOBUj^SRI) declaring the is 
address of the next data to be reproduced accord- 
ing to the special reproduction mode used, and a 
plurality of program chain information (VTS_PGC) 
declaring the system stream (CELL) reproduction 
sequence in a program chain comprising more than 20 
one system stream (CELL), are recorded to said 
information layer (RS), chsiracterized by at least 
one system stream (CELL) being shared by a plu- 
rality of program chains (VTS_PGC). tiie address 
information (C_FVOBU_SA) of ttie first data off a 25 
system istream (CELL), and the address Infforma- 
tion (C_:LVOBU_SA) of the last reproduction control 
information (NV) of a system stream (CELL), being 
recorded to the program chain information 
(VTS_PGC) according to the reproduction 30 
sequence of a system stream (CELL), and either 
address information (relative address in tiie 
VOBU_SRI) in the system stream (CELL) contain- 
ing the reproduction control information (NV) 
recording the trick play Information (v6bU_SRI). or 35 
a value (3FFFFFFFh in tiie VOBU_SRI) indicating 
an address outside the system stream (CELL), 
being recorded to tiie address information written to 
the trick play information (VOBU_SRI) of the repro- 
duction control information (NV). 40 

4. The multimedia optical disk (M) acconding to clkim 
2 or claim 3, wherein when a value determined by a 
conventional special reproduction mode points to a 
location otiier than a system stream (CELL) con- 4s 
taining reproduction' control information (NV)-to 
which trick play inforhiatiori (VOBU_SRI) is written, 
address information written to trick play information 
(VOBU^SRI) of at least first or last reproduction 
contrpldnformation (NV) of asystem stream (CELL) so 
is an address value of 0. 

5. The multimedia optica) disk (M) according to claim 
2 or claim 3, wherein when a value determined by a 
conventional special rqvoduction mode points to a ss 
location otiier than a system stream (CELL) con- 
taining reproduction control information (NV) to 
which trick play information (VOBU_SRI) is written. 



address information written to trick play information 
(VOBU_SRI) of at least first or last reproduction 
control information (NV) of a system stream (CELL) 
is an address value of SFFFFFFh, 

6. The multimedia optical disk according to claim 2 or 
claim 3. wherein address information relating to 
reverse direction reproduction is an address value 
of 0 in trick play information (VOBU_SRI) in a first 
reproduction control information (NV) of a system 
stream (CELL), address information relating to for- 
ward direction reproduction is an address value of 0 
in ti-ick play information (VOBU_SRI) in a last repro- 
duction control information (NV) of a system stream 
(CELL), and address Infottnation written to other 
trkk play information (VOBU_SRI) is an address 
value pointing to the last reproduction control infor- 
mation (NV) of said system stream (CELL) when 
said address information relates to forward direc- 
tion reproduction, and is an address value pointing 
to the first reproduction control Information (NV) of 
said system stream (CELL) when said address 
information relates to reverse direction reproduc- 
tion, when a value determined by a corwentional 
special reproduction mode points to a location other 
than a system stream (CELL) containing reproduc- 
tion control information (NV) to which trick play 
information (VOBU_SRI) is written. 

7. The multimedia optical disk (M) according to one of . 
dairhs 1 . 2. 3, 4, and 5, wherein first data contairied 
in a system stream (CELL) is always reproduction 
control information (NV). trick play infornhation is 
address information of reproduction contrpr infor- 
mation (NV) of a location to be reproduced, and one 
system stream (CELL) is recorded interleaved in 
units (NV) recorded by reproduction control infor- 
mation (NV), allocated with reproduction control 
information (NV) at the beginning. 

8. An optical disk reproduction apparatus (bCD) for 
reproducing data recorded to a multimedia optical 
disk storing a plurality of system streams (CELL) 
interleaving in GOP units data containing at least 
moving picture data, and reproduction control infor- 
mation (NV) containing trick play information 
(VOBU_SRI) declaring the address of the next data 
to be reproduced according to the special reproduc- 
tion mode used, and a plurality of program chain 
information (VTS_PGC) declaring a reproduction 
sequence of at least one system stream (CELL), 
wherein at least one system stream (CELL) is 
shared by a plurality of program chains 
(VTS_PGC), and address information of first data in 
a system stream (CELL), and address information 
of last reproduction control information (NV) in a 
system stream (CELL) are recorded to program 
chain information (VTS_PGC) according to tiie 
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reproduction sequence of the system stream 
(CELL), said optical disk reproduction apparatus 
(DCD) comprising: a reading means (2000) for 
reading data from the optical disK a track buffer 
means (2400) for temporarily storing read data, a 5 
data decoding means (2500) for separating video 
data, a plurality of sub-picture data, a plurality of 
audio data, and reproduction control information 
(NV) interleaved to system stream (CELL) read 
from the track buffer means, a system stream ,0 
(CELL) selection means for reading program chain 
information (VTS_^PGC in the VTSI) from data read 
by the reading means, and outputting address infor- 
mation of the next system stream (CELL) to be 
reproduced, comprising selecting reproduction 75 
sequence counter ® storing sequence information 
(C_PBI ^•) declaring a fonward-direction reproduc- 
tion sequence in program chain (VTS^PGC) of sys- 
tem stream (CELL) being reproduced, and address 
information of first data in system stream (CELL) in 20 
a sequence declared by reproduction sequence 
counter Q) of program chain information 
(VTS_PQC) when the reproduction mode is fonrard 
reproduction, and an address selection means 
(step #331212) selecting address information 25 
(C_LVOBU_SA) of last reproduction control infor- 
matton (NV) of the system stream (CELL) in the 
sequence declared by the reproduction sequence 
counter (j) of the program chain information 
(VTS_PGC) when the reproduction mode is reverse 30 
reproduction, a reproduction position selection 
means (step #33 1 203) for reading address informa- 
tion of next data to be reproduced according to the 
cun-ent reproduction mode from tfie trick play infor- 
mation (VOBU^SRI) of the reproduction control 35 
information (NV) separated by the data decoding 
means, a reading means controller (step #331205) 
for controlling the reading means according to the 
address Information output by tfie system stream 
selection means and the reproduction position 40 
selection means, and an output processor for 
decoding tfie video data, sub-picture data, and 
audio data, and outputting the audfo and video 
according to tiie decoded result. 

4S 

An optical disk reproduction apparatus (DCD) for 
reproducing data recorded to a multimedia optical 
disk storing a plurality of system streams (CELL) 
Interleaving In GOP units data containing at least 
moving picture data, and reproduction control infor- so 
mation (NV) containing trick play information 
(VOBU.SRI) declaring ihe address of the next data 
to be reproduced according to the special r^roduc- 
tion mode used, and a plurality of program chain 
information (VTS^PGC) declaring a reproduction 55 
sequence of a system stream (CELL) in a program 
chain (VTS.PGC) containing at least one system 
stream (CELL), wherein at least one system stream 



(CELL) is shared by a plurality of program chains 
(VTS_PGC). and address information of first data in 
a system stream (CELL), and address information 
of last reproduction control information (NV) in a 
system stream (CELL) are recorded to program 
chain information (VTSJPGC) according to tfie 
reproduction sequence of tfie system stream 
(CELL), where address information written to trick 
play information (VOBU_SR!) of reproduction con- 
ti-ol information (NV) is either address information in 
a system stream (CELL) containing reproduction 
control information (NV) to which said trick play 
information is written, or a value pointing to other 
tfian said system stream (CELL), said optical disk 
reproduction apparatus (DCD) comprising: a read- 
ing means (2000) for reading data from the optical 
disk, a track buffer means (2400) for temporarily 
storing read data, a data decoding means (2500) 
for separating video data, a plurality of sub-picture 
data, a plurality of audio data, and reproduction 
conti-ol information (NV) interieaved to system 
stream (CELL) read from tfie track buffer means, a 
system sto-eam (CELL) selection means for reading 
program chain information (VTS_PGC) from data 
read by the reading means, and outputting address 
information of the next system stream (CELL) to be 
reproduced, comprising selecting a reproduction 
sequence counter storing sequence information 
(C_PBI #j) declaring a forward-direction reproduc- 
tion sequence in program chain (VTSJPGC) of sys- 
tem sti-eam (CELL) being reproduced, and address 
information (C_FVOBU_SA) of first data in system 
stream (CELL) in a sequence declared by repro- 
duction sequence counter of program chain infor- 
mation (VTS.PGC) when the reproduction mode is 
fonward reproduction, and an address selection 
means selecting address information 
(C_LVOBU_SA) of last reproduction conti-ol infor- 
mation (NV) of the system sti-eam (CELL) In tfie 
sequence declared by the reproduction sequence 
counter of tfie program chain information 
(VTS_PGC) when ihe reproduction mode is reverse 
reproduction, a reproduction address selection 
means tfiat is a means (step #331203) for reading 
address information of next data to be reproduced 
according to the current reproduction mode from 
tfie trick play information {VOBU_SRI) of the repro- 
duction control information (NV) separated by tfie 
data decoding means, comprising a reproduction 
address extraction means for exti-acting address 
information, and a system stream end detection 
means (step #331208 or step #33121 1) for output- 
ting a sti-eam end signal indicative of an end or 
beginning of a system stream (CELL) when (YES in 
step #331206) the extiracted addiress information is 
a value (3FFFFFFh) pointing outside the system 
stream (CELL), a reproduction sequence changing 
means for generating a signal incrementing a 
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reproduction sequence counter one when the 
reproduction mode is forward, and decrementing a 
reproduction sequence counter one when- the 
reproduction mode is reverse, when a stream end 
detection signal is output, a reading means control- 5 
ler for controlling the reading means according to 
the address information output by the system 
stream selection means and the reproduction posi- 
tion selection means, and an output processor for 
decoding the video data, sub-picture data, and w 
audio data, and outputting the audio and video .. 
accordtfig to the decoded result 

10. The optical disk reproduction apparatus (DCD) 
according to claim 9. wherein the system stream 75 
end detection means detects that the extracted 
address information points outside the system 
stream (CELL) by detecting an address value of 
(3FFFFFFh); and outputs as address Information of 

the next data to reproduce, address information off , 20 
last reproduction control information {NV).-;or -^^^ 
address information off first data, for the system 
stream (CELL) currently being reproduced, with a 
stream end signal indicative of an end or beginning 
off a system stream (CELL). . 25 

11. An optical disk reproduction apparatus (DCD) that 
is an optical disk reproduction apparatus for repro- 
ducing data ffrom a multimedia optical disk (M) 
according to one of claims 6. 7, 8 [sic], and 9 [sic] 30 
wherein first data contained in a system streiEun 
(CELi.) is sflways reproduction control information 
(NV), trick play information (VOBU_SRI) is address 

. information of reproduction control information (NV) 
of a tocation to be reproduced, and one system 55 . 
stream (CELL) is recorded interleaved in units (NV) 
recorded by reproduction control information (NV), . 
allocated with reproduction control information (NV) 
srt the beginning: 

. -- 40 

12. A method for reproducing data from a multimedia 
optical diskr(M), being a method for reproducing . 
using a reading means data recorded to an multi- 
media i0ptical> disk storing a plurality offxisystem - 
streams (CELL) interleaving in GOP units data con- 4s: . 
taining.at least moving picture data. and reproduce 

tion control Information (NV) . containing trick* play.' 
information (VOBU^SRI) declaring: the address of - 
the next, data to be reproduced^ according to the 
spedal reproduction. mode used, and a plurality of so: 
program chain information (VTS^PGG). declaring a 
reproduction sequence of at -least one system « 
stream (CELL), wherein at least one'system stream . . 
(CELL) is shared by a plurality of program chains = 
(VTS_PGC), and address information off ffirst data in ss 
a system stream (CELL), and address infformation 
off last reproduction, control information (NV) in a 
system- stream (CELL) are recorded to program 



chain information (VTS_PGC) according to the 
reproduction sequence of the system stream 
(CELL), whereby when a reproduction mode is for- 
ward reproduction, and a system stream (CELL) 
being currently reproduced is reproduced to the 
end. a reproduction sequence counter indicative of 
a forward reproduction sequence in a program 
chain (VTS_PGC) of a current system stream 
(CELL) is incremented one. address information of 
first data in a system stream (CELL) pointed to by 
this reproduction sequence counter is extracted, a 
reading means is moved to a position indicated by 
tills address infformation. and the next data is read, 
and when a reproduction models reverse reproduc- 
tion, and a system stream (CELL) being currentiy 
reproduced is reproduced to the beginning, a repro- 
duction sequence counter indicative of a forward 
reproduction sequence in a program chain 
(VTS_PGC) of a current system stream (CELL) is 
decremented one, address information of a last 
reproduction conti^ol information (NV) in a system 
stream (CELL) pointed to by this reproduction 
sequence counter is extracted, and a reading 
means is moved to a position indicated by this 
address information, and the next data is read. 

13. A method for reproducing data from a multimedia 
optical disk (M). being an apparatus [sic] for repro- 
ducing using a reading means data recorded to an 
multimedia optical disk storing a plurality off system 
streams (CELL) interleaving in GOP units data con- 
taining at least moving picture data, and reproduc- 
tion control information (NV) containing trick play 
information (VOBU_SRI) declaring the address of 
the next data to be reproduced according to the 
special reproduction mode used, and a plurality off 
program chain information (VTS_PGC) declaring a 
reproduction sequence of a system stream (CELL) 
in a program chain (VTS_PGC) containing at least 
one system stream (CELL), wherein at least one 
system stream (CELL) is shared by a plurality off 
program chains (VTS_PGC). and address informa- 
tion off ffirst data in a system stream (CELL), arKi* 
address information of last reproduction control 
information (NV) in a system stream (CELL) are 
recorded to program chain information (VTS_PQC) 
ac<X)rding to the reproduction sequence off the sys-' ^ 
tem stream (CELL), where address information 
written to trick play infformation off reproduction con- 
trol informatfon (NV) is eitiier address information in 
a system stream (CELL) containing reproduction 
control information (NV) to which said trick play 
information (VOBU_SRI) is written, or a value point- 
ing to other than said system stream (CELL), 
whereby when a reproduction nfiode is fonvard 
reproduction, address information off data to be 
reproduced next ffor fforward reproduction is read 
ffrom trick play information in reproduction control 
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information (NV). and when the value points inside 
a system stream (CELL), a reading means Is 
moved to the position indicated by the value and the 
next data is read, but when the value points outside 
a system stream (CELL), a reproduction sequence 5 
counter indicative of a fonward reproduction 
sequence in a program chain (VTS_PGC) of a cur- 
rent system stream (CELL) is incremented one, 
address information of first data in a system stream 
(CELL) pointed to by this reproduction sequence 
counter is extracted, a reading means is moved to a 
position indicated by this address information, and 
the next data is read, and when a reproduction 
mode is reverse reproduction, address information 
of data to be reproduced next for reverse reproduc- ,5 
ton is read from trick play information in reproduc- 
tion control information (NV). and when the value 
points inside a system stream (CELL), a reading 
means is moved to the position indicated by the 
value and the next data is read, but when the value 20 
points outside a system stream (CELL), a reproduc- 
tion sequence counter incficative of a reverse repro- 
duction sequence in a program chain (VTS_PGC) 
of a cun-ent system stream (CELL) is decremented 
one. address information of a last reproduction con- 2s 
trol information (NV) in a system stream (CELL) 
pointed to by this reproduction sequence counter is 
extracted, and a reading means is moved to a posi- 
tion indicated by this address information, and the 
next data is read. 

30 

14. The metfiod for reproducing data from a multimedia 
optical disk.(M) according to claim 11 or claim 12, 
wherein address (SFFFFFFh) is used as a value 
pointing outside tfie system stream (CELL), and 35 
when an address written to trick play information is 
ottier than 0. ttie address is a location inside system 
shream (CELL), and when the address is 
(3FFFFFFFh). the address points outside the sys- 
tem stream (CELL). 40 

15. A method for recording to a multimedia optical disk 
(M) for reconding a plurality of system sti-eams 
(CELL) interleaving in GOP units data containing at 
least moving picture data, and reproduction conti-ol 45 
information (NV) containing trick play information 
(VOBU^SRI) declaring the address of next data to 

be reproduced according to a special reproduction 
mode used, and a plurality of program chain infor- 
mation (VTS^PGC) representing a reproduction so 
sequence of a system sti-eam (CELL) jn a program 
chain (VTS^PGC) comprising more th^n one sys- 
tem stream (CELL), wherein when at least one sys- 
tem stream (CELL) is shared by a plurality of 
program chains (VTS^PGC), address information 55 
of first data of e^ch system stream (CELL), and 
address infomiation of last reproduction control 
information (NV) of a system sti^eam (CELL), are 



written to program chain information (VTS_PGC) 
. according to a reproduction sequence of a system 
stream (CELL), and address information of data to 
be reproduced next is written to trick play informa- 
tion according to the reproduction mode. 

16. A method for recording to a multimedia optical disk 
(M) for reconjing a plurality of system streams 
(CELL) Interieaving in GOP units data containing at 
least moving picture data, and reproduction conti-ol 
information (NV) containing ti-ick play information 
(VOBU_SRI) declaring tiie address of next data to 
be reproduced accoiding to a special reproduction 
mode used, and a plurality of program chain infor- 
mation (VTS_PGC) representing a reproduction 
sequence of a system stream (CELL) in a program 
chain (VTS_PGC) comprising more than one sys- 
tem stream (CELL), wherein when at least one sys- 
tem stream (CELL) is shared by a plurality of 
program chains (VTS_PGC). address information 
of first data of each system stream (CELL) Is written 
to program chain information (VTS_PGC) accord- 
ing to a reproduction sequence of a system stream 
(CELL), and address Information written to trick 
play Information of at least first or last reproduction 
conti-ol information (NV) of a system stream (CELL) 
is characterized by [sic] a value determined by a 
conventional special reproduction mode writing 
address information in a system sti-eam (CELL) 
containing reproductfon conti-ol information (NV) to 
which trick play information (VOBU_SRI) is written, 
or a value indicative of a location other tiian a sys- 
tem stream (CELL). 

17. A metiiod for recording to a multimedia optical disk 
(M) for recording a plurality of system streams 
(CELL) interieaving in GOP units data containing at 
least moving picture data, and reproduction conti-ol 
information (NV) containing ti-ick play information 
(VOBU.SRI) declaring the address of next data to 
be reproduced according to a special reproduction 
mode used, and a plurality of program chain infor- 
mation (VTS_PGC) representing a reproduction 
sequence of a system stream (CELL) in a program 
chain (VTS_PGC) comprising more tiian one sys- 
tem stream (CELL), wherein when at least one sys- 
tem stream (CELL) is shared by a plurality of 
program chains (VTS^PGG). address information 
of first data of each system sti-eam (CELL), and 
address information of last reproduction conti^ol 
information (NV) of a system sti-eam (CELL), is writ- 
ten to program chain information (VTS_PGC) 
according to a reproduction sequence of a system 
stream (CELL), and address information written to 
frick play information of at least first or last repro- 
duction conti-ol information (NV) of a system sti-eam 
(CELL) is characterized by [sic] a value determined 
by a conventional special reproduction mode writ- 
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ing address information in a system stream (CELL) 
containing reproduction control information (NV) to 
which trick play information (VOBU_SRI) is written, 
or a value indicative of a location other than a sys- 
tem stream (CELL). 5 

18. The method for recording to a multimedia optical 
disk (M) according to claim 15, 16, or 17. wherein 
when a value determined by a conventional special 
reproduction mode points to a location other than a io 
system stream (CELL) containing reproduction 
control information (NV) to which trick play informa- 
tion (VOBU_SRI) is written, address information 
written to trick play informiation of at least first or last 
reproduction control information (NV) of a system is 
stream (CELL) is an address value of SFFFFFFh. 

19. The method for recording to a multimedia optical 
disk (M) according to claim 15. 16. or 17. wherein 
address information relating to reverse direction so 
reproduction is an address value of 0 in trick play 
information (VOBU_SRI) in a first reproduction con- 
trol information (NV) of a system stream (CELL)i 
address information relating to forward direction 
reproduction Is an address value of 0 in trick play 2S 
information (VOBU_SRI) in a last reproduction con- 
trol information (NV) of a system stream (CELL), 
and address information written to other trick play 
information (VOBU_SRI) is an address value point- 

ing to the last reproduction control information (N V)^ 30 
of said system sti-eam (CELL) when said address 
information relates to forward direction reproduc- 
tion, and is an address value pointing to the first 
reproduction control information (NV) of said sys- 
tem stream (CELL) when said address information 3S. 
relates to reverse jdirecliqn reprpduc^^^ when a 
value determined by a conventional special repr6- 
duction mode points to a location other than a sys- 
tem stream (CELL) containing reproduction control 
information (NV) to which trick play information 4o 
(VOBU^SRI) is written. 

20. The method for recording to a multimedia optical 
disk (M) according to claim 1 5. 16. 1 7. 1 8, 1 9. or 20 
[sic], wherein first data contained in a system 4S 
stream (CEUL) is always reproduction control infor- 
mation (NV). trick play information (VOBU_SRI) is 
address information of reproduction control infor- 
mation (NV) of a location to be reproduced, and one 
system stream (CELL) is recorded interleaved in so 
units recorded by reproduction confrol information 
(NV). allocated with reproduction conti-ol informa- 
tfon (NV) at the beginning. 
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Fig. 1 1 
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Fig. 13 
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Fig. 19 
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Fig. 27 
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Fig. 28 



VOB number 
(VOB.NUM) 



VOB#1 



VOB #2 



VOB#vb 



/ 

/ 



Start time of video material ( VOB_VST) 



End time of video material (VOB_VEND) 



Kind of video material (VOB__V_KIND) 



Video encode bit rate (V_BR) 



Start time of audio material (VOB_AST) 



End time of audio material (VOB_AEND) 



Kind of audio encode (VOB_A_KIND) 



Audio bit rate (A_BR) 



70 



EP 0 847 195 A1 



Fig. 2 9 
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Fig.32 
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